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I- REAL PARTY IN IN TEREST 

The inventor of the above-noted patent application has assigned all respective rights in 
relation to the invention entitled "METHOD AND APPARATUS FOR BROADCASTING 
INFORMATION OVER A NETWORK" including any resulting patent, to U.S. West, Inc., a Delaware 
corporation formerly with a place of business in Denver, Colorado. This assignment was for the 
parent U.S. Patent Application No.09/322,375 (Now U.S. Patent No. 6,41 1 ,992 issued June 25, 
2002) of the above noted patent application (i.e., a continuation patent, application) and was 
recorded at the U.S. Patent Office on Aug. 27, 1999 at Reel 010196, Frame 0922. This invention, 
including any resulting patent, was then assigned by U.S. West, Inc. to Qwest Communications 
International Inc., a Delaware corporation with a place of business in Denver, Colorado, in the 
Assignment that was recorded at the U.S. Patent Office on September 25, 2000 at Reel 010814, 
Frame 0339. These assignments were subsequently, recorded for the above noted patent application 
at the U.S. Patent Office on Jan. 2, 2007 at Reel 018698, Frame 0929 and at Reel 018698, Frame 
0949. Therefore, Qwest Communications International Inc. is the real party in interest in this 
appeal. 
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II. 



RELATED APPEALS AND Ih 11 



Appellant, Appellant's legal representative, the assignee of the above-noted patent 
application, and the named inventors for the above>noted patent application are all unaware of any 
appeal(s) or interference(s) which will directly affect, be directly affected by, or have a bearing on 
the Board's decision in the pending appeal. 



III. STATUS OF CLAIMS 

The status of the claims is as follows: 

1 . Claims cancelled: 7, and 12 - 21 ; 

2. Claims pending: 1 - 6, 8 - 1 1 and 22 - 25; 

3. Claims rejected: 1 - 6, 8 - 1 1 and 22 - 25; and 

4. Claims appealed: 1 - 6, 8 - 11 and 22 - 25. 
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IV. STATUS OF AMENDMENTS (37 CFR § 1.192(c)(4)) 

The Applicant filed U.S. Patent Application No. 10/001,662 on Oct. 18, 2001 . The 
application contained 21 total claims, 2 of which (Claims 1 and 12) were independent claims. The 
Applicant received a Non Final Office Action mailed Jan. 29, 2003 (the "First Non Final Office 
Action"), wherein Claims 1 — 11 were rejected by the original Examiner under 35 U.S.C. § 101. 
Claims 1 - 21 were also rejected under 35 U.S.C. § 112, first paragraph and second paragraph. 
Claims 1 through 21 were also rejected under 35 U.S.C. § 102(b) as being anticipated by U.S. 
Patent No. 4,331,974 (issued May 25, 1982), U.S. Patent No. 5,155,591 (issued Oct. 13, 1992; 
hereafter "Wachob"), U.S. Patent No. 5,446,919 (issued Aug. 29, 1995), U.S. Patent No. 5,515,098 
(issued May 7, 1996), U.S. Patent No. 5,661,516 (issued August 26, 1997); or U.S. Patent No. 
5,600,364 (issued Feb. 4, 1997) and under 35 U.S.C. § 102(e) as being anticipated by WO 99/46708 
(published September 16, 1999), U.S. Patent No. 6,006,265 (issued Dec. 21, 1999; hereafter 
"Rangan"), WO 00/17775 (published Mar. 30, 2000), or U.S. Patent No. 6,298,348 (issued Oct. 2, 
2001). Claims I - 21 were also rejected under 35 U.S.C. § 103(a) as being unpatentable over the 
Examiner's personal experience in NFL Super Bowl advertising. The Applicant filed an 
Amendment and Response on June 30, 2003 amending claims 1, 2, 4, 8, 9, 1 1 - 14, 17, and 18, 
cancelling claims 7 and 20 to address informalities, and arguing the distinctions in the claims as 
compared to the above cited references. 

The Applicant received a Final Office Action mailed on August 25, 2003 (the "First Final 
Office Action") rejecting claims 2, 10, and 15 for various informalities and rejecting claims 1 - 6, 8 
- 11, 13 through 19, and 21 under 35 USC § 101 for previously recited reasons. The Examiner also 
maintained the rejections of claims 1 - 6, 8 - 19, and 21 under 35 U.S.C. § 1 12, first paragraph and 
second paragraph, 35 U.S.C. § 102, and 35 U.S.C. .§ 103(a). The Applicant filed a Request for 
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Continued Examination and a Preliminary Amendment therewith on October 24, 2003 amending 
claims 1,3-6, canceling claims 12 - 21, and adding new claims 22 - 25. On January 18, 2006, 
newly assigned Examiner Raquel Alvarez mailed a'Non Final Office Action (the "Second Non 
Final Office Action") rejecting claims 1 - 6 and 8 - 25 (even though claims 12-21 were already- 
cancelled) under 35 USC § 103(a) as being unpatentable over Rangan, et ah in view of Wachob, 
although claims 8-21 were no longer pending. The Applicant amended claims 1 and 6 to correct 
informalities on May 18, 2006 and traversed each of the Examiner's rejections including those 
which the Examiner never articulated. In a Final Office Action mailed August 11, 2006 (the 
"Second Final Office Action"), the Examiner maintained the rejections to claims 1 - 6 and 8 - 25 
under 35 U.S.C. § 103(a) and summarily dismissed the Applicant's arguments and the Applicant's 
contentions that she did not address the claims. The Applicant responded to the Second Final 
Office Action on October 11, 2006, traversing the Examiner's rejections to claims 1 - 6, 8 - 1 1, and 
22 - 25 without amending. In response, the Examiner mailed an Advisory Action on October 20, 
2006 stating that the application was still not in condition for allowance. A Notice of Appeal was 
filed by the Applicant on November 13, 1006 and this Appeal Brief is the result thereof. 



V. 



SUMMARY OF CLAIMED SUBJECT MATTER 



Independent Claim 1 

Generally, claim 1 of the present invention relates to transmitting digital media from a 
network server over a data network while providing the ability to determine demographic 
information of a user who receives the digital media such that commercial content can be inserted 
into the digital media according to the demographic information. See e.g., page 9. lines 7 - 10 of 
the present application. In accordance with claim 1, a system user logged into a network server may 
be detected. See, e.g., page 15, lines 21-23 of the present application. The user may be connected 
to the network from a remotely located computer. See, e.g., page 7, lines 14 - 1 5 of the present 
application. One or more hypertext links may be presented, such that the system user may choose 
to view a particular multimedia presentation by selecting a hypertext link. See e.g., page 16, lines 5 
- 7 of the present application. The chosen multimedia presentation may then be retrieved from a 
database or external source and transmitted to the user's remotely located computer via the data 
network. See, e.g., Figure 1 and page 7, line 9 through page 8, line 2. The user's IP address may be 
identified and used to retrieve demographic information pertaining to the user (e.g., the IP address 
may be representative of a particular user(s) on the Internet fitting a certain demographic profile). 
See e.g., page 15, lines 13-18 and page 19, lines 16 - 22 of the present application. Based on the 
demographic information, a commercial can then be selected from a commercial database for 
insertion into the chosen multimedia presentation during a commercial break. See e.g., page 16, 
lines 3-23 and page 19, lines 8 - 15 of the present application. When the commercial break is 
detected during transmission of the multimedia presentation over the data network, the selected 
commercial may be retrieved from a commercial database and transmitted to the system user. See, 
e.g., page 16, lines 10 - 14 of the present application. The demographic information may be 
acquired from the system user through a screen display (e.g., an Internet user may enter 
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demographic information through a web browser). See, e.g., page 7, lines 14-19; page 9, lines 7 - 
10; and page 15, line 21, to page 16, line 2, of the present application. 

Claim 2 

Additionally, the invention relates to the simultaneous delivery of different commercials to 
various viewers of the same show during a broadcast. See generally, page 16, lines 3-19. For 
example, in accordance with claim 2, multiple system users logged into a broadcast server over a 
network may be detected and identified so that each user's demographic information may be 
retrieved from a database. See e.g. , page 15, lines 21 - 23 of the present application. A number of 
commercials may be retrieved, each of which is associated with the demographic information of at 
least one of the system users. See, e.g., page 16, lines 14-19. Multimedia information may be 
broadcast from the server over the data network to the system users. See e.g., page 16, lines 3 - 7 of 
the present application. During a commercial break detected in the multimedia broadcast, the 
commercials may be delivered simultaneously to different users based on the demographic 
information. See e.g., page 19, lines 12 - 14 and page 1 1, line 18 through page 12, line 3 of the 
present application, 

Claim 4 

In accordance with claim 4, the invention may further include monitoring system users to 
accumulate additional demographic information, such as age of the user, sex of the user, and 
geographic location of the user. See e.g., page 9, lines 7 - 10; Figure 10; and page 15, lines 10-18 
of the present application. 

Claim 5 

Additionally, the invention includes inserting commercials into ad hoc commercial breaks, 
such as may occur at unpredictable times during the broadcast of a sporting event. In accordance 
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with claim 5, the occurrence of an ad hoc commercial break may be detected. See e.g., Figure 22 
and page 18, line 20, to page 19, line 2 of the present application. 

Claim 9 

In accordance with claim 9, the invention may also include querying a system user for 
demographic information when the user logs into the network server. See e.g., page 9, lines 20 - 25 
of the present application. 

Claim 11 ■ 

In accordance with claim 1 1 , identification of a user may be performed by reading the IP 
address of the user and/or by reading a login ID of the user. See e.g., page 15, lines 10 - 16 of the 
present application. 

Independent Claim 22 

Generally, independent claim 22 of the present invention relates to a system that provides 
for the transmission of multimedia information over a data network (e.g., World Wide Web of page 
2, lines 15 - 16 of the present application). For example, in accordance with claim 22, a network 
server may be used for transmitting digital media from a over a data network while providing the 
abi lity to determine demographic information of a user who receives the digital media such that 
commercial content can be inserted into the digital media according to the demographic 
information. See e.g., page 9, lines 7 - 10 of the present application. More specifically, the 
network server includes a network interface that establishes connections with system users over the 
data network. See e.g., page 7, lines 14-22 of the present application. The network server also 
includes a schedule database which stores multimedia schedules and screen displays that are 
presentable to system users for entering demographic information. See e.g. , page 9, lines 2 - 4 of 
the present application. The network server also includes a program source, such as a broadcaster 
broadcasting television programs or a database for maintaining multimedia information. See e.g., 
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Figure 1 and page 7, line 19, to page 8, line 2 of the present application, The network server also 
includes a commercial database for storing commercials that may be transmitted to users based on 
the demographic information. See e.g., page 12, lines 8 - 1 1 of the present application. The 
network server also includes a processor configured to retrieve multimedia information based on the 
schedules for transmission to users through the network interface. The processor is also configured 
to select and transmit commercials based on the demographic information. See e.g., page 8, line 16 
- page 9, line 1 1 of the present application. For example, the processor may transmit different 
commercials to different users at the same time depending on demographic information associated 
with each commercial and user. See, e.g., page 1 l,.line 18 - page 12, line 3 of the present 
application. 
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VI. GROUN DS OF REJECTION TO BE REVIEWED ON AP PEAL 

1. Claims 1 - 6, 8 - 1 1, and 22 - 25 have been rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Rangan (i.e., U.S. Patent No. 6,006,265) in view of Wacfaob (i.e., U.S. Patent No. 
5,155,591). 
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VII. ARGUMENTS 

The Examiner rejected claims 1 - 6, 8 - 1 1, and 22 - 25 under 35 U.S.C. § 103(a) as being 
unpatentable over Rangan in view of Wachob, in the Second Non Final Office Action mailed 
January 18, 2006 without addressing ail of the claims. In the Second Non Final Office Action, the 
Examiner merely argued how Rangan and Wachob obviate certain limitations in the independent 
claims (i.e., claims 1 and 22). When the Applicant brought this failure to address all of the claims 
to the Examiner's attention, the Examiner issued a Final Office Action simply stating that all claim 
limitations were addressed in the Non Final Office Action mailed on May 22, 2006. The 
Examiner's communication on May 22, 2006, however, was an interview summary in which no 
rejections were discussed. The Applicant considered the Examiner's assertion as meaning that all 
claim limitations were addressed in the Second Non Final Office Action with a mailing date of 
January 1 8, 2006. However, the Applicant maintains that the Examiner merely rejected all claims 
and only addressed claim limitations associated with claims 1 and 22 and did not even address each 
independent claim element correctly. That is, the Examiner did not point out where all of the claim 
elements of claims 1 and 22 are taught. 

Claim 1 

As one example of the Examiner's erroneous rejection, the Examiner rejected claim 1 by 
stating that Rangan, at column 20, lines 52 - 60, teaches the claimed steps of receiving through a 
screen display demographic information for the system user and using the IP address to access a 
database and retrieve demographic information that is associated with the system user. However, 
Rangan instead merely states that a client subscriber/user/viewer (SUV) may click to a hyper video 
commercial to initiate a Web transaction (column 20, lines 49 and 50 of Rangan) and that the 
feedback from the transaction results in on-the-fly commercial insertion that may be tuned to local 
demographic conditions and user profiles. Nowhere does Rangan state that demographic 
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information for a system user is received through a screen display. In fact, Rangan does not 
mention or even suggest a screen display for entering demographic information in any form. 

The claimed display allows the user to enter demographic information so that preferable 
commercials may be inserted into the multimedia presentation. The demographic information of 
the Applicant's claims originates from system users who have logged on and provided certain 
demographic information about themselves. This information is stored within a database which 
allows the programmer to ascertain a particular audience according to the demographic information 
and subsequently select commercials that are based on that demographic information. See e.g., 
page 9, lines 5 - 24, page 10, lines 1 - 19 of the present specification. Rangan, on the other hand, 
teaches the automatic analysis of streaming video and the insertion of hotspots over hyperlinks to 
make hypervideo. Column 17, lines 49 - 53 of Rangan. While Rangan is certainly a challenging 
reference to comprehend, the Applicant finds no teaching or reasonable suggestion regarding the 
entrance of demographic information through a screen display as the Applicant claims. 

Regardless, Rangan's mere statement of commercial insertion in column 20, line 55 is not 
the same as the commercial transmission of a retrieved commercial during a commercial break. 
Rather, Rangan's alleged teaching of a commercial insertion generally regards insertion of hypertext 
links within video content to make "hypervideo", which allows a user to select additional video 
content during presentation of the hypervideo. For example, Rangan explicitly states that "in 
accordance with the present invention, the insertion is not of clips. . . but rather of hyperlinks", 
column 20, lines 15-22. The specification of Rangan is fraught with explicit references stating 
that insertion is in the context of hyperlinks that are associated with commercials. See e.g. , column 
18, lines 51-59. This differs from the Applicant's claims because, among other reasons, the 
Applicant claims the insertion of commercials based on demographic information as opposed to the 
insertion of hyperlinks. 
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Additionally, the Examiner cited In re Keller, 642 F.2d 413 (C.C.P.A. 1981), stating that the 
Applicant argues against the references individually and that one cannot show nonobviousness by 
attacking references individually where the rejections are based on combinations of references. The 
Examiner's understanding of In re Keller is fundamentally wrong. In re Keller does relate to an 
applicant's arguments in favor of patentability over an obviousness rejection (i.e., § 103(a)) based 
on a combination of references, as in the present application. However, In re Keller showed that the 
applicant stipulated that every element of the applicant's claims was taught by the combined 
references. The applicant in that case chose to argue that the cited references were not combinable 
because they were not analogous. More specifically, the Keller applicant argued that a secondary 
reference, which included one claim element (i.e., a digital timing circuit) within a teaching of 
mammalian heart stimulation, was not combinable with a primary reference, which included all of 
the applicant's claim elements except for a digital timing circuit within a teaching of cardiac pacing 
The applicant there still claimed an analog timing circuit that was easily replaceable with the digital 
timing circuit of the secondary reference. This differs from the present case because the Applicant 
here is only stating other features that the primary reference does not teach. In other words, the 
cited references do not teach all of the Applicant's claim elements as required and as the Applicant 
maintains. 

To illustrate, the Examiner stated that Rangan teaches the Applicant's element of receiving 
through a screen display demographic information for the system user and using the IP address to 
access a database and retrieve demographic information that is associated with the system user. The 
Applicant pointed out that Rangan does no such thing. Rangan does not teach receiving 
demographic information through a screen display. The Applicant then pointed out what one 
skilled in the art would understand Rangan to be teaching, to illustrate the differences between what 
the Examiner asserted and what the Applicant claims. Thus, the Applicant has shown that Rangan 
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does not teach all of the Applicant's claim elements as the Examiner suggests. As is well known, 
"all elements of the claim must be found in the reference." In re Royka, 490 F,2d 981 (C.C.P.A. 
1974), See also, M.P.E.P. § 2143.03. 

The Examiner also stated that Rangan does not specifically teach detecting a commercial 
break but that Wachob does. The Applicant agrees that Rangan does not teach detecting a 
commercial break; but neither does Wachob. The Examiner pointed to Figure 3 of Wachob to state 
that Wachob teaches detecting a commercial break'. In Figure 3, Wachob teaches reading tag 
information that is transmitted by the system head (box 150). For example, Wachob states that 
"[fjhe tag information defines if and when a commercial is about to occur, how long it will last, and 
which channel the converter should tune to." Column 7, lines 13-21 of Wachob. Nothing in this 
reference suggests detection: rather, the information is provided by the headend. 

Regardless, Wachob is not analogous art. Rangan teaches selection of hypertext, links within 
video content for distribution over the Internet. Wachob teaches commercial insertion during 
predetermined times via cable television (see e.g., column 4, lines 30-35 of Wachob). The types of 
content are totally different. That is, Rangan delivers audio and/or video content digitally via 
Internet protocols through an Internet network (see. e.g.. Figure I and column 24, lines 32 - 51 of 
Rangan), whereas Wachob delivers audio and/or video content in an analog fashion via radio 
frequency AM or FM modulation schemes (see e.g.. Figure 1 and column 4, lines 56 - 68 and 
column 1 - 7 of Wachob). Such analysis is inconsistent with the reasonableness standard stated in 
In re Oetiker, 977 F.2d 1443, 1447 (Fed. Cir. 1992) (stating "it is necessary to consider the 'reality 
of the circumstances 5 ••- in other words, common sense - in deciding in which fields a person of 
ordinary skill would reasonably be expected to look for a solution to the problem facing the 
inventor"). See also MPEP § 2141.01(a). 
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Even if the two references were cornbinable, there is simpiy no motivation to combine. For 
example, Wachob is specifically related to delivering content to a cable television user via the 
converter (a.k.a. a set-top-box) of Figure 1 in conjunction with the remote control of Figure 2. 
Rangan does not teach or reasonably suggest the use of such boxes because all of Rangan's 
communications are performed via computers through the Internet. Additionally, there has to be 
some reasonable expectation of success in the combination. See In re Merck & Co., Inc., 800 F.2d 
1091, 231 USPQ 375 (Fed. Cir. 1986). See also M.P.E.P. § 2143.02. There is no reasonable 
expectation of success because one cannot simply "jam" analog content through the internet by- 
means of an analog cable TV box. Reasonableness aside, there is simply no way to combine 
Rangan and Wachob and expect the combination to work because Rangan is directed to the Internet 
and Wachob is directed to conventional television - two vastly different forms of communication. 
Rangan even expresses this fact, at column 29, lines 39-42, where it states that its teachings are 
"in marked contrast to conventional broadcast television where there is no interactivity with the 
viewer and/or the viewers video playback, especially including commercials." 

Because neither Rangan nor Wachob teach or reasonably suggest all of the Applicant's 
claim elements either alone or in combination, and because Rangan and Wachob are not 
cornbinable, the Applicant maintains that claim 1 is novel and non obvious in view of the cited 
references. 

Claims 2-3, 5-6, 8, and 10 

Other examples of the Examiner's shoddy examination are found in the rejections of claims 
2 - 6 and 8 - 1 1 . For example, in the Second Non Final Office Action, the Examiner never 
addressed the broadcasting multimedia information of claim 2, the monitoring of system users of 
claim 4 (argued separately below), the querying of system users of claim 9 (argued separately 
below), the presenting of an interactive component of claim 10, or the reading of an IP address of 
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claim 1 1 (argued separately below). These dependent claims were simply lumped together in the 
rejections of the associated independent claim 1 without these limitations ever being addressed. 
Claims should never be grouped together in a common rejection, unless that rejection is equally 
applicable to all claims in the group. M.P.E.P § 707.07(d). The Applicant maintains that the 
rejection clearly cannot apply to all of the claims because the elements of the dependent claims 
recite unique features that are not recited in the patentable independent claim. The Examiner should 
have issued another non-final office action to address these claims as the Applicant requested. 
Instead, the Examiner only addressed these limitations in the Second Final Office Action and 
applied similarly incorrect logic in the rejections thereof. Because claims 2-3 , 5-6, 8, and 10 each 
include all of the limitations of claim 1 and more. Applicant submits that these claims are allowable 
for at least the same reasons as claim 1 and respectfully requests such disposition. 
Claim 4 

The Applicant maintains that Rangan does not teach monitoring a system user's computer to 
accumulate demographic information as claimed by the Applicant in claim 4. In fact, Rangan 
explicitly teaches away from this claim limitation when Rangan states "[t]his knowledge is not 
gained by any sort of insidious monitoring of the Client SUVs. Instead, it should be recognized that 
the Client SUVs from time to time identify, and link, to the (hyper)video that each wishes to view." 
Column 18, lines 7-11 of Rangan. For the first time in the Second Final Office Action, the 
Examiner stated that Rangan does teach monitoring a system user's computer to accumulate 
demographic information at column 29, lines 35 - 39. Here, Rangan states that an advertiser may 
develop statistics on "click-throughs." A click-through, as is known to those skilled in the art, is 
obtained from users who "click" on a web page. Such is analogous to monitoring y&ur &wm 
website to determine how many other people "click" on your website. This, however, does not 



18 



constitute m&mM&rMg an&ther pers&n f s computer as the Applicant claims. For at least these 
reasons, claim 4 is allowable and such disposition is respectfully requested. 

Claim 5 

As Examiner has pointed out, Rangan does not teach detecting a commercial break; but, 
neither does Wachob, In claim 5, the Applicant claims an ad hoc commercial break. The ad hoe 
commercial break of the Applicant's claims is a type of commercial which may be shown during a 
program which has a number of nondesignated commercial breaks (e.g., sporting events with 
unpredictable timeouts). Page 10, lines 15-19 of the present application. The Applicant has 
already shown that Wachob does not teach detection of a commercial break. As such, Wachob 
cannot teach detection of an ad hoc commercial break. In fact, Wachob has no teaching or 
reasonable suggestion regarding any type of unpredictable commercial break detection. Since 
Wachob does not teach or reasonably suggest an ad hoc commercial break detection and since 
Rangan admittedly does not, claim 5 must be allowable and such disposition is respectfully 
requested. 

Claim 9 

Claim 9 recites a step of querying a system user to provide the demographic information 
when the system user logs on to the network server. Neither Rangan nor Wachob teach or 
reasonably suggest querying a user for demographic information when the system user logs on to 
the network server as the Applicant claims in claim 9. Rather, Rangan only states that demographic 
information is used without making reference to how the information is acquired. Wachob, on the 
other hand, states that information is provided by means of a remote control or "household survey" 
(see e.g., column 1, lines 48 - 64 of Wachob) without teaching or reasonably suggesting any type of 
querying of a system user being performed by the network, particularly when the system user logs 
on to the network. That is, Wachob' s users input data to a system without regard to any query. 
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Since Rangan and Wachob neither teach nor reasonably suggest querying of the system user for 
demographic information when the system user logs on, the cited references are simply insufficient 
in nullifying the patentable features of the Applicant's claim. For at least these reasons, claim 9 is 
allowable in view of the cited references and the Applicant, therefore, respectfully requests such 
disposition. 

Claim 11 

Rangan and Wachob also do not teach or reasonably suggest receiving a login ID from a 
system user, either alone or in combination, as the Applicant claims in claim 1 1 . In fact, Wachob is 
essentially precluded from doing so because the non-analogous art of Wachob is directed towards 
cable television and not the network servers associated with the Internet of the Applicant's claims 
(e.g., cable television users do not log on to their set top boxes). The Examiner first addressed this 
claim in the Second Final Office Action nakedly arguing that Rangan teaches a login. The 
Applicant has made a thorough search of Rangan and finds no such teaching or even any form of 
the word "log". Since neither Rangan nor Wachob teach or reasonably suggest receiving a login ID 
as the Applicant claims, claim 1 1 is allowable in view of these references in such disposition is 
respectfully requested. 

Claims 22-25 

Claims 22-25 relate to a network server for use in transmitting multimedia information and 
commercials over a data network to users who enter demographic information about themselves. 
The Examiner rejected claim 22 based on Official Notice, stating that it is old and well known "to 
schedule when certain information is to be scheduled in order to designate a fixed time for an 
event." Even if this is true, the Examiner still failed to address where a schedule database stores 
one or more screen displays which are presentable and through which the system users enter 
demographic information. Moreover, the Applicant cannot even fully comprehend the Examiner's 
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rejection because Examiner rejected claim 22 based on Rangan and Wachob. The Applicant 
maintains that neither Rangan nor Wachob teaches or reasonably suggests such storage. The 
Applicant further maintains that it is not well known to those skilled in the art to provide a schedule 
database that stores one or more screen displays which are presentable and through which the 
system users enter demographic information. Accordingly, the Applicant believes claim 22 is 
allowable and respectfully requests such disposition. 

Regarding the Examiner's Official Notice, it has been held that an Examiner cannot simply 
"pick and choose" elements to depreciate the claimed invention as such would be hindsight. See 
e.g., In re Fine, 837 F.2d 1071, 1075 (CA.Fed., 1988): see also, M.P.E.P. § 2143.03. The 
Applicant pointed out that such a schedule database is not well-known or old and demanded proof 
of such an assertion. The Examiner stated, however, that the Applicant did not properly challenge 
the Examiner's official notice and cited "In re Boon" at M.P.E.P. § 2144.03. There is no such 
citation at M.P.E.P. § 2144.03. Regardless, to adequately traverse "Official Notice", an applicant is 
required to specifically point out the supposed errors in the Examiner's action, which would include 
stating why the noticed fact is not considered to be common knowledge or well known in the art. 
M.P.E.P. § 2144.03. The Applicant stated that the claimed scheduling database is used to store data 
pertaining to scheduling. Storing screen display data in a scheduling database would essentially be 
storing data other than what a typical database would be originally configured for. Accordingly, the 
Applicant respectfully requests withdrawal of the Examiner's Official Notice. 

As with the dependent claims of claim 1, the Examiner also failed to individually address 
claims 23 - 25 depending from claim 22. For example, the Examiner never addressed the program 
source of claim 23 or the simultaneous transmission of claim 24. These dependent claims were 
lumped together in the rejection of the associated independent claim 22, which the Applicant 
maintains is impermissible because the rejection is not equally applicable to all claims in the group. 
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See M.P.E.P § 707.07(d). The Applicant pointed out the Examiner's failure to address each claim 
in the Second Non Final Office Action and requested a new Non Final Office Action, which the 
Examiner summarily dismissed. The Applicant maintains that claims 22 - 25 are allowable in view 
of the cited references and, therefore, respectfully requests such disposition. 



VIII, CLAIMS APPENDIX 

1 . A method of transmitting multimedia from a network server information over a data 
network comprising the steps of: 

detecting at least one system user logged into a network server through a connection 
established over the data network from a remotely located computer and identifying an IP address 
associated with the connection of the remotely located computer with the network server, and 
presenting one or more hypertext links which are selectable so as to view a selected multimedia 
presentation; 

receiving through a screen display demographic information for the at least one system user; 

using the IP address to access at least one database to retrieve demographic information 
stored therein associated with the at least one system user; 

based on the selected hypertext link accessing the selected multimedia presentation in a 
computer memory and transmitting the selected multimedia presentation information from the 
network server over the connection to the remotely located computer; 

detecting an inserted commercial break during the transmission of the multimedia 
presentation over the connection; 

based on the demographic information associated with the at least one system user, 
accessing a commercial database and retrieving at least one commercial associated with the 
demographics for the at least one system user; and 

transmitting the retrieved commercial to the at least one system user over the connection 
during the commercial break. 

2. The method of claim 1 further comprising the step of: 

detecting a plurality of system users logged into the network server over the data network; 
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identifying each of the. plurality of system users connected to the broadcast server and 
accessing the at least one database to to retrieve demographic information stored in first memory for 
each of the plurality of system users 

broadcasting the multimedia information from the broadcast server over the data network to 
the plurality of system users; 

detecting a commercial break during broadcasting of the multimedia information; 

retrieving from memory plurality of commercials, each of which is associated with the 
demographic information of one of the plurality system users; 

during the commercial break, simultaneously broadcasting the plurality of commercials, 
wherein each of the commercials in the plurality of commercials is broadcast to a system user 
within the plurality of system users with the demographic information associated with the 
commercial. 

3 . The method of claim 1 wherein the multimedia information comprises at least one 
of: a data stored in memory and a live program received from a remote source. 

4. The method of claim 1 further comprising the step of monitoring the at least one 
system user receiving the multimedia presentation and accumulating additional demographic 
information for the multimedia presentation. 

5 . The method of claim 4 wherein the step of detecting a commercial break is 
performed for ad hoc commercial breaks. 
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6. The method of claim 1 further comprising the step of identifying one or more 
appropriate commercials based on the time available during an identified commercial break. 

Claim 7 (Cancelled) 

8. The method of claim 7 wherein the demographic information includes at least one of: 
age of the at least one system user, sex of the at least one system user, and geographic location of 
the at least one system user. 

9. The method of claim 1 further comprising the step of querying the least one system 
user to provide the demographic information when the at least one system user logs onto the 
network server. 

10. The method of claim 1 further including the step of presenting an interactive 
component in the broadcast of the at least one commercial whereby additional information may be 
retrieved from the memory based on the at least, one system user's response to the interactive 
component. 

1 1 . The method of claim .1 wherein the step of identifying the at least one system user 
comprises at least one of: reading the LP. address the at least one system user logged into the 
network server and receiving a login ID from the at. least one system user upon logging into the 
network server. 

Claims 12-21 (Cancelled) 
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22. A network server configured for transmitting multimedia information over a data 
network comprising: 

a network interface in communication with a data network, said network interface 
configured to establish one or more connections with systems user connecting with the network 
server over the data network: 

a schedule database within which is stored one or more schedules for the multimedia 
information as well as one or more screen displays which are presentable and through which the one 
or more system users enter demographic information; 

a program source from which the multimedia information included listed in the one may be 
retrieved; 

a commercial database within which are stored commercials which are transmittable to the 
at least one system user, wherein each of the commercials is associated with one or types of the 
demographic information; 

a processor in electrical connection the network interface, the schedule database and the 
program source, wherein the processor is configured to retrieve the multimedia information selected 
from the one or more schedules, and to transmit the retrieved multimedia information to the system 
user over the connection established by the system user through the network interface; and 

said processor further configured to select one or more commercials associated with the 
entered demographic information and to transmit the selected commercial with the selected 
multimedia information. 

23. The network server of claim 22 wherein the program source comprises at least one 
of: a database containing the multimedia information as data files and an external broadcast source. 
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24. The network server of claim 22 wherein the processor is further configured to 
transmit a plurality of multimedia information presentations simultaneously to different 
system users. 

25. The network server of claim 22 wherein the data network is the World Wide Web. 
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EVIDENCE APPENDIX 
None. 



X. RELATED PROCEEDINGS APPENDIX 

None, 
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XI. CONCLUSION 

Based upon the foregoing, Appellant respectfully requests the Board to reverse the 
Examiner's § 103(a) rejections of all pending claims and to pass the above-identified patent 
application to issuance, 



Respectfully submitted, 

MARSH FISCHMANN & BREYFOGLE LLP 

By: /R OBERT G. CROUCH/ 

Robert G, Crouch 
Registration No. 50,843 
3151 South Vaughn Way, Suite 41 1 
Aurora. Colorado 80014 
Date: March 14, 2007 (720) 562-5506 
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[57] ABSTRACT 

Streaming digital hypervi-'c lcludi > f 

hyperlinks is distributed upon a digital communications 
network from a hypervideo server, normally an Internet 
Service Provider, to multitudinous client subscribers/users/ 
viewers (client. SUVs), Some or all of the client SUVs 
receive the same hyperlinks at the same place in the stream- 
ing hypervideo. Some small fraction of the client SUVs 
selectively volitionally exercise a fraction of the total 
hyperlinks, causing an access in the background of the 
unfolding hypervideo across the digital communications 
network to yet another server commonly called a "Video On 
Web server", or "VOW server". The VOW sever interprets 
each hyperlink request in consideration of (i) the identity of 
the exercising client SUV and, most commonly, (ii) addi- 
tional data of a demographic, socioeconomic, credit, view- 
ing preference, security and/or past hyperlinking history 
nature. The VOW Server supplies each hyperlink-exercising 
cli ni St IV with a potentially custom hyperlink — normally 
in the form of a network universal resource locator (URL) or 
an index to a file of URLs — while keeping track of com- 
mercially useful data regarding P - (s 
Each client SUV uses its own associated received URL to 
retrieve a potentially unique resource. The resource can be 
internal, such as an executable software program, but is 
normally located somewhere on the network and is typically 
in the nature of tailored and/or targeted advertisements, 
messages of personal or local or temporal pertinence and/oi 
urgency, and/or the results of contests or lotteries. Hyper- 
video hyperlinks are thus dynamically resolved during 
streaming network communications to support full custom 
hyperlinking by each of multitudinous, t, rked c 
SUVs. 

31 Claims, 11 Drawing Sheets 
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(a) Hotspots: Objects in video marked as 
hot regions (static information) 

(b) Hyperlinks associated with hotspots 
marked as either of the following 

(1) Type A: Absolute (Static) 

(2) Type B: Relative (Dynamic) 



feed 2 




* auth.mpg 
stored here 



Fig. 3b 



SUV; 



SUV 2 v SUVn 



(a) Client streams in the video 
(auth. mpg) 

(b) If link is of type A, client 
directly goes to the specified 
URL. 

- (c) If link is of type B, client 
contacts the Vow server for 
the URL. 




VOW server resolves the link and sends the_ 
URL back to the client, it also loges the request 



Fig. 3c 



U.S. Patent Dec. 21, 1999 Sheet 4 of 11 6 ? 006 ? 265 



v Live 
feed 2 



auth.mpg 
stored here 



/ ^-Video , 

/ " server 1 



Client fetches video or URL 
resource from video server 



Fig. 3d 
Video Stream 91~\ 



z 



Control Streamy 



Video 




Vow 


11 (http://) 


server 9 




server 1 





Fig. 5 




U.S. Patent 



Dec. 21, 1999 



Sheet 5 of 11 



6,006,265 




Fig. 4 




Fig. 6 



U.S. Patent Dec. 21, 1999 Sheet 7 of 11 6,006,265 



User's web page playing hypervideo in VOW! VCR 




Fig. 7 



U.S. Patent Dec. 21, 1999 Sheet 8 of 11 6,006, 



User's web page playing hypervideo in VOW1VCR 




Fig, 8 



U.S. Patent 



Dec. 21, 1999 



Sheet 9 of 11 



6,006,265 




U.S. Patent 



Dec. 21, 1999 



Sheet 10 of 11 



6ftm,265 




Fig. 10 



U.S. Patent Dec. 21, 1999 Sheet 11 of 11 



6,006,265 




6,0C 

1 

HYPERLINKS RESOLUTION AT AND BY A 
SPECIAL NETWORK SERVER IN ORDER 
TO ENABLE DIVERSE SOPHISTICATED 
• HYPERLINKING UPON A DIGITAL 
NETWORK 

RELATION TO RELATED PATENT 
APPLICATIONS 

• The present patent application is related to the following 
U.S. patent application: Ser, No. 09/088,513 for the REAL- 
TIME RECEIPT, DECOMPRESSION AND PLAY OF 
COMPRESSED STREAMING VIDEO/HYPERVIDEO, 
WITH (1) DISPLAY OF PAST SCENES, (2) RETRO- 
riVE HYPERLINKING AND /OR RETROSPEC- 
TS VB RECORDING AS ARE BOTH KEYED TO DIS- 
PLAYED PAST SCENES, AND, WITH SPECIAL 
SERVER SUPPORT. (3) DIVERSE VERSATILE 
RESPONSES TO HYPERLINKS, filed on J«n. 1, 1998, 
which application concerns a client subscriber/user/viewer 
upon the same digital communications network as is the 
special server of this application, and the of the related 
applications is to inventors including certain inventors of the 
present application. 

All applications are. assigned to common assignee Tata 
America International Corporation. The contents of the 
related patent applications are incorporated herein by refer- 
ence. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present and related inventions generally concern (i) 
the machine-automated distribution, processing and network 
communication of streaming digital video/hypervideo, par- 
ticularly upon digital networks having network content 35 

ders (no ternet Cot ent Provider", or 

'TCP"), network service providers (nominally an "Internet 
Service Provider", or "ISP"), and network client subscribers/ 
users/viewers ("client SUV's"). The present and related 
inventions also generally concern the provision of diverse 40 
sophisticated responses — including branching, storage, 
playback/replay, subscriber/user-specific responses, and 
contests — to SUV "click-throughs" on hyperlinks embedded . 
within streaming digital hypejvideo. 

The present invention in particular concerns software as 
processes operating at a special digital communications 
network server called a "Video On Web Server", or "VOW 
Server". This VOW Server does cot normally serve stream- . 
ing digital video, nor bypervideo (which instead comes from 
video servers that may be associated with any of content so 
providers, network service providers, and/or third-party net- 
w ' i ■ < upon the network, but rather 

interprets hyperlinks present in streaming digital hypervideo 
when these hyperlinks are selectively exercised by indi- 
s t v ( W Vs) of the hyper- 
video. The hyperlink inieqjretation that is the field of the 
t i ed to customizing the 

hyperlinked response(s) accorded each and every client 
SUV. As well as, being customized to the individual client 
SUV, the responses are very diverse in nature, potentially 
invoking many different network resources at many different 
network locations. 

2. Description of the Prior Art 
2.1 introduction to the Theory of Hypervideo 

There is no requirement to read the present section 
2.1— -which section is based on the early investigations and 
research into hypervideo of Sawhney, et al., as transpired at 
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MIT (reference cited below) — in order to understand the 
function, and, at a crude level, the purpose(s) of the present 
invention. However, hypervideo is, as of the present time 
(1998) very new, and few people have experienced it. The 
S present section may accordingly beneficially be read in order 
to gain a "feel" for hypervideo. 

More fundamental!), the present section discusses the 
considerable power of hypervideo, and ends with a discus- 
sion of the empowerment that hypervideo provides to a 
to user-viewer. The present and related inventions, although 
they can be narrowly though! of as mere systems and 
methods fe>! delivi ring iowly commercials in the hypervideo 
environment, are really totally consistent with the more 
' profound, and the mote ennobling, purposes of hypervideo. 
15 Therefore the present section may also beneficially be read 
to understand to what purposes--— both good and ill — 
hypervideo tnay be put, and as background to how the 
present and related inventions serve these purposes. 

In recent years Sawhney, el al . a! MY] (reft rence ;it* c 
2.0 below) have developed an experimental hypermedia proto- 
• type called "HyperCafe" as an illustration of a general 
hypervideo system. This program places the user in a virtual 
cafe, composed primarily of digital video clips of actors 
involved in fictional conversations its the cafe; HyperCafe 
25 allows the user to follow different conversations, and offers 
dynamic opportunities of interaction via temporal, spatio- 
temporal and textual links to present alternative narratives. 
Textual elements are also present in the form of explanatory 
text, contradictory subtitles, and intruding narratives. Based 
30 on their work with HyperCafe, Sawhney, et al. have been 
leaders in discussing the necessary components and a frame- 
work for hypervideo structures, along with the underlying 
aesthetic considerations. The following discussion is drawn 
entirely from their work. 

"Hypervideo" can be defined as "digital video and 
hypertext, offering to its user and author the richness of 
multiple narratives, even multiple means of structuring 
narrative (or non-narrative), combining digital video with a 
polyvocal, linked text." Hypervideo brings the hypertext 
link to digital video. See Sawhney, Nitic, David Balcom, Ian 
Smith "HyperCafe: Narrative and Aesthetic Properties of 
Hypervideo." Proceedings of the Seventh ACM Conference 
on Hypertext. New York: Association of Computing 
Machinery, 1996. 

An even earlier approach to hypermedia was proposed by 
George Landow, in which he offered rules for hypermedia 
authors, rules that took into account hypermedia's derivation 
from print media and technologies oi w 
proposed that hypermedia "authors" learn which aspects of 
writing applied to the emerging hypermedium, and 
traits or cbaracte istics needed redefinition and rethinking. 
He noted Fo cotnmun < rmedta authors 

must make use of a range of techniques, suited to their 
medium, that will enable the reader to process the inform a 
tion presented by In - 1 > f < 

P. "The Rhetoric of Hypermecna So ne £ 
Journal of Computing in Higher Education, 1 (1989), pp. 
39-64; reprinted in Hypermedia and Literary Studies, ed. by 
Paul Delany and George P. Landow, Cambridge, Massachu- 
setts: MIT Press, 1991. 

Hypervideo has its roots in both hypertext and film. As a 
result, hypervideo embodies properties of each field, but 
wholly can be placed m neither, for hypervideo is not strictly 
linear motion picture, nor is it strictly hypertext. This 
convergence known as hypervideo comments on each 
discipline, on their jimJarjtir,,, and ot 
Hypervideo is potentially nonlinear, like hypertext, but 
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displays moving image-,, iike film Hypervideo can signify 
through montage, iike film, and can generate multiple 
dictions, like hypertext. Properties of each medium are 
present in hypervideo. These properties take on new forms . 

5 

Hypervid* s rativs film and video from a ' 

linear, fixed environment to one of multivoeality; narrative 
sequences (video clips followed by other video clips) need 
hot subscribe to linearity. Instead of creating a passive 
viewing subject, hypervideo asks its user to be an agent 
actively involved in creation of text through choice and ' 
interaction.' Hypervideo car; potentially change viewing sub- 
ject from a passive consumer of the text to an active agent . 
who participates in the text, and indeed, is engaged in 
constructing the text. 

Just as hypertext necessitated a re-reading of the act of 15 
reading and writing, hypervideo asks for a re- viewing of 
narrative film and film making and practices of viewing a 
film. Hypervideo redefines the viewing subject by breaking 
. the frame of the passive screen. Hypervideo users are 
participants in the creation of text, as hypertext readers are. 20 

Research is presently (circa 1997) projected to determine 
just how users of hypervideo systems navigate, interact with, 
and experience hypervideo-texts. Just as J. Yellowlees Dou- 
glas has exhaustively researched hypertext readers and the 
act of hypertext reading, similar projects are expected to be 25 
undertaken by hypervideo researchers. See Douglas, J. Yel- 
lowlees. "Understanding the Act of Reading: the WOE 
Beginner's Guide to Dissection." Writing on the Edge, 2.2. 
University of California at Davis, Spring 1991, pp. 112-125. 
See also Douglas, J. Yellowlees. "'How Do I Stop This 30 
Thing?': Closure and Indeterminacy in Interactive Narra- . 
tives " Hyper/Text/Theory, ed. by George P. Laudow. Bal- 
timore: The Johns Hopkins University Press, 1994, 

Hypervideo is related to film, Hypervideo has the poten- 
tial to reveal important associations present in a film, and the 35 
constructedness of linear filmic narratives, and to this end, 
would be a beneficial tool for use with film studies education 
and research. Hypervideo can make available, by way of 
link opportunities, the different associations and allusions 
present in a filmic work. These associations are made <so 
manifest with hypervideo, made available for the student (or 
teacher) to see aud explore. Relationships between different 
films can then be tracked, linked, commented on, revealed. 

Hypervideo engages the same idea of "processing" that 
hypertext writing does: in writing hypertext, one makes 45 
available the process of writing, representing it visually (in 
the form of the web the writer builds), rhetorically (in the 
linking structure of the work, the points of arrival and 
departure present in the text)-and so one makes apparent the 
tensions and lines of force present in the act of writing, aud 50 
the creation or reification of narrative. "Writing" hypervideo 
does the same for image-making-that is, makes clear the 
notion of constructing images and narrative. In the case of 
hypervideo, "narrative ' c t <hve film making. Just 

as hypertext D3S within it the potential to reveal the con- 55 
structedness of linear writing, and to challenge that 
structure, hypervideo does the same for narrative film 
making-while also offering the possibilities for creating rich 
hypervideo texts, or videotexts. 

How does narrative film function in hypervideo? Narra- so 
tive film is necessarily re-contextualized as part of a network 
of visual elements, rather than a stand-alone filmic device. 
Because narrative segments can be encountered out of 
sequence and (original) context, even strictly linear video 
clips are given nonlinear properties. 65 

Sergei Eisenstein pioneered the concept and use of mon- 
tage in film. Hypervideo reveals and foregrounds this use. 



Eisenstein proposed that a juxtaposition of disparate images 
through editing Conned an idea in the viewer's head It was 
1 v i <"a Qdee oi hesis whs 

taposed through editing, with another, disparate image, or 
antithesis, produced a syathe&i.- m the view np 
mind. In other words, synthesis existed not on film as 
idea-image, but was a literal product of images to form a 
separate image-idea that existing solely for viewer, 

Eisenstein deliberately opposed himself to continuity 
editing, seeking out and exploiting what Hollywood could 
call "discontinuities." He staged, shot, and cut his films tor 
the maximum collision from shot to shot, sequence to 
sequence, since he believed that only through being force io 
synthesize such conflicts does the viewer participate in a 
dialectical process. Eisenstein sought to make the collisions 
and conflicts no! only perceptual but also emotional and 
intellectual." See Bordwell, David and Kristin Thompson. 
Film Art: An Introduction. Fourth Edition. New York: 
McGraw-Hill, Inc., 1993. 

Hypervideo potentially reveals this thesis/antithesis 
dialectic, by allowing the user to choose an image-idea (in 
this case, a video clip), and juxtaposing it wish another 
image-idea (another video clip). Hypervideo allows the user 
So act on discontinuities and collisions, to engage with 
colliding subtexts and threads. 

The user selects a video clip from a black canvas of three 
or four dips. Each clip lies motionless on the canvas. The 
user drags a clip onto another one, and they both start to play. 
Voices emerge and collide, and once-separate image-ideas 
now play concurrently, with one image extending the frame 
of the other. The user is left to determine the relationship 
between the two (or three or four) video clips. 

Such video intersections recall Jim Rosenberg's notion of 
simultaneities, or the "literal layering on top of one another 
of language elements." See Rosenberg, Jim. "Navigating 
Nowhere/Hypertex Infrawhere." ECHT 94, ACM SiGLMK 
Newsletter. December 1994, pp. 6-19. Instead of language 
elements, video intersections represent the layering of visual 
elements, or more specifically, visual elements in motion. 
This is not to say that words, in the ease of Rosenberg's 
Intergrams, are not visual elements; on the contrary, they 
are. in fact, their image-ness is conveyed with much more 
clarity (and even urgency) than are non-simultaneous words, 
or words without an apparent visual significance (save the 
"transparent" practice of seeing "through" letter-images into 
words into sentences into concepts). Once the word-images 
have to contend with their neighbor-layers for foreground 
screen space, their role in both the practice of signification 
(where meaning is contingent on what neighborly 0's and 
l's are NOT), and as elements of a user interface (words that 
yield to the touch or click or wave of the mouse) become 
immediate and obvious. Nor is this to say that video clips 
aren't "language elements"; on the contrary, they are. The 
hypervideo clip is caught, as are words and letters, in the act 
tion and relational meaning-making (. . . what 
neighborly 0's and l's are not . . . ), mutable to the very- 
touch of user, to the layers above and below. 

The hypervideo author can structure these video intersec- 
tions in such a way that only X and Y clips can be seen 
together, or X and Z if Y has already been seen (like 
is'oryspaec's juar< 1 , and so on. and ths, author can 
decide if a third video should apt. ! 
of X and Y. For example, Video X is dragged onto Video Y 
and they both start So play. The author can make a choice to 
then show video Z as a product, or synthesis, of the 
juxtaposition of "Videos X and Y, that reflects or reveals the 
relationship between Videos X and Y. This literal revealing 
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, s is mads ;si! 1 - i i , ■, 
Of course, no synthesis need be literally revealed; that can 
be left up to She viewer. While the interactions are structured 
by the hypervideo author or authors (as Eisenstein structured 
the placement and editing of thesis and antithesis idea- 
images), the meaning-making is left up to the hypervideo 
user. His or her choice reveals meaning to him with each 
video intersection; meaning in the system is neither fixed nor 
pre-determined. This empowering principle of hypertext is 
also a property of hypervideo, 
2.2, Recent Practical Developments in Hypervideo 

The V-Active HyperVideo Authoring Environment of 
Ephyx Technologies, Ltd. is a hypervideo authoring tool 
reportedly designed to develop interactivity in full-motion 
digital video applications. The V-Active product is based on 
a proprietary hypervideo technology that enables (i) auto- 
matic definit - , or hotspots, within an applica- 
tion's video stream and (ii) linking of those objects to video, 
sound, and text files, plus Web URLs. 



ing effective — meaning powerful and useful — hyper d< 
and (ii) machine (computer) processes for providing 
versatile, unique and highly useful responses to the hyper- 
video so made. 

The hypervideo (i) so made, and (ii) so used, goes way 
beyond mere digital television with embedded hyperlinks 
communicated upon a digital network — interesting, useful 
and, in parts, novel as even this concept may be. Instead, the 
present and related inventions contemplate full custom 

, hypervideo: each and every one of hundreds and of thou- 
sands of subscriber/user/viewers upon a digital communi- 
cations network is, by and large, (a) receiving copious digital 
hypervideo hyperlinks, with (b) any and all actions (' dick 
throughs") on any hyperlinks being resolvec i pei ! 

■ when it happens, (ii) from which client SUV it happens, and 
(Hi) even in respect of what is happening at other client 
SUVs. 

Alt k ugt , to re 1 1 y initi > j pc ss ible that, 

circa 1998, tailored customization and versatility of any 



Using an image processing algorithm, the V- Active' prod- 20 great magnitude in the delivery of digital information so 



uct is reported to define a video hotspot once and to then 
automatically maintain this hotspot across the video 
sequence. The software is reportedly capable of maintaining 
the hotspots even through fast action and low-light video 
sequences. Developers can choose among a dozen hotspot 2 
attributes, including author-defined shapes, overlay colors, 
and cursor-overrun reactions. 

Ephyx calls this authoring strategy hypervideo — full- 
motion digital video with embedded hyperlinks to related 
content through automated means of creating video ?. 
"hotspots." In accordance with the general concept of 
hypervideo, these hotspots link moving objects within a 
video sequence to a variety of media, including static 
pictures, text, sounds, URLs, other video sequences, c 



executable software applications. Hotspots are evident to the is network hypervir 



extensive as is hypervideo could be realized in and by 
existing computers communicating across existing broad- 
band digital networks, the present and rela i 
quite feasible. Basically, in accordance with the present and 
related inventions, hypervideo management (for benefit of 
client SUVs, individually; as is the subject of the present 
invention) is partially divorced from hypervideo generation 
and delivery (as are the subjects of two related patent 
applications) is yet still further partially divorced from 
hypervideo use (in client SUVs; as is the subject of yet 
another related patent application). Thus the several 
demanding functions for a complete hypervideo system are 
distributed upon the digital communications network. By 
this partitioning of the various functions within a digital 



, the computer software pro- 



user either by changes in the cursor shape 
object-specific highlighting. Other features of the V-Active 
product include automated motion tracking, synchronized 
playback of multiple media elements streaming 
simultaneously, and platform independence and support for 
numerous digital video formats. 

The Ephyx software reportedly also enables developers to 
create applications in which end-users simply click on 
' • - within a video to link instantly to related 



of the present and related inventions— -already imple- 
mented and presently running on (i) modern digital network 
servers communicating streaming digital hypervideo across 
cable networks to (H) cable modems present in Pentium®- 
class personal computers of client SUVs — permit unprec- 
edented flexibility. (Pentium® is a registered trademark of 
Intel, Inc.) 

Basically every single one of thousands of client SUVs 
served by a single (typically neighborhood) network s< 



content via various connections, including selected URLs. 45 provider (ISP), typically by coaxial cable, is able to select 

The V-Active. product further reportedly permits that hyper- for viewing— whenever, in whatsoever sequence and at 

Hnked videos created with V-Active may be integrated into whatsoever pace, interniption(s) and branching as are then 

a variety of environments; a V-Active Director Xira inte- desired —several scores of different choices of video ■ 1 

grates V-Active interactive video elements into Director which is normally held available over a span of some days, 

applications, while the V-Active ActiveX Control and so and then replaced In return for permitting thousands of 

V-Active Netscape Plug-In embed hyperlinked video into client SUVs each to "do their own" thing in (hypervideo 



Web page 

With V-Active, authors can enable pointing and clicking 
between digital video hotspots, and they can also define any 
moving objects as gateways to other video sequences or to 5 
activating other applications, Interactive video clips pro- 
duced with V-Active can be integrated into existing snvi- 
ronments using a Macromedia Director 5 Xtra and Microsoft 
Active X control. Refer to the web page aod product , 
literature of Ephyx Technologies, P.O. Box 12503, 9 M&s&rii i 
Street, Herzliya 46733, Israel (http://www.ephyx.com as of 
1998). 

SUMMARY OF THE INVENTION 
The present and related inventions contemplate high- t 
performance hypervideo. In general, the inventions contem- 
plate (i) machine (computer) processes for efficiently mak- 



viewiag, the ISP definitively knows what particular (hyper) 
video each (and every) individual client SUV is receiving. 
Furthermore, importantly, and in accordance with the 
ven tet* « I ich rr ly be 

located at the ISP, or as another server on the network) 
comes to know which responses (if any) each (and every) 
client SUV ever makes to hyperlinks. 

Using the power of this 
resources provided/linked to the individual client SUVs — 
notably commercials — are "targeted" on the particular client 
SUV. Thus the "price" to the client SUV for high 
performance, flexibility and personal control in his/her 
(hyper)video viewing is thai information is surrendered 
about his/her individual habits and preferences-- which situ- 
ation is, of course, nonexistent for television broadcast either 
on the airwaves or upon digital communications networks. 
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1. Context of ihe Present Invention Within Related and/or (v) contest results, in accordance with his, her or their 

Inventions, and Within a Con >1 } nabling unique (network) identity. 

Hypervideo on Digital Communications Networks ' In functioning to manage and to condition pkral streams 

A first and a second related invention to the present ■ of digital hypervideo responsively to, at least partially, the 

invention respectively concern (i) making and (ii) distribut- s unique 

ing hypervideo, Hypervideo is (i) made from (a) video and individual SUV, a computer program of the present raven- 

(b) hyperlinks by software-based editing processes. Such a tion operating at the special server (which server may, 

hypervideo editor is taught in the related patent application however, also be an ICP, an ISP or a LNA) cooperatively 

for HYPERVIDEO AUTHORING AND EDITING BY interacts with a compatible computer program operating in 

DRAGGING AND DROPPING DIVERSE HYPERLINKS so the network-connected computer of the SWV. 

INTO AUTO MAT! C A LLY- DETECTED SCENE The special server is called a "Video On Web Server", or 

HOTS POTS, WITH SCENES' DURATIONS BEING FUR- "VOW Sc. -v. (It j i IOTV™ 

THER AUTOMATICALLY DETECTED. Server", where HOTV™ is a trademark of Tata America 

Perhaps more interestingly, these processes may be auto- Internationa! Corporation, assignee of the present invention; 

mated or semi-automated, so as to efficiently seamlessly is although this term will not be used within this spe. 

insert hyperlinks into video, including in real time while the At first presentation, the names "Video On Web Server", or 

'-■ i SS, Server" may be slightly confusing: this server does 

made and (ii) distributed in real time, for example in the not particularly, primarily, or iyper)video on 

form of a hyperlink-annotated live video newscast. The the digital network, or web, it enables hypervideo on the 

insertion of video and hypervideo clips and hyperlinks in 20 digital network, or web, in a manner to be explained. To say 

streaming digital video/bypervideo is taught within the again, the VOW Server is not normally a server of streaming 

related patent application for REAL-TIME TARGETED digital video, or hypervideo, which normally comes from 

INSERTION OF VIDEO CLIPS, HYPERVIDEO CLIPS video servers that may be associated with any of content 

AND/OR HYPERLINKS IN COMPRESSED STREAM- providers, network service providers, and/or third-party net- 

ING VIDEO, INCLUDING DYNAMICALLY AT MUL- 25 work sites such as advertisers. The VOW Server is given its 

TIPLE POINTS BETWEEN CONTENT PROVIDERS expansive name because, however, it will soon be seen to 

AND SUBSCRIBERS IN DIGITAL NETWORKS. enable the distribution and the progression, and the custom 

The inserted hyperlinks will ultimately, and indirectly in distribution and progression, of (hyper)video to, and at, all 

accordance with the present invention, serve to access still the network client SUVs. 

further, other, digital (hyper)yideo clips, particularly com- 30 The computer program resident at the client SUV, and 

mercials. This hyperlink insertion is normally done at any of . complimentary to the "VOW Server", is called a "Video On 

a network content provider, or Interne! Content Provider (an • Web Video Cassette Recorder", or "Video on Web VCR", or 

"ICP"), an Internet Service Provider (an "ISP"), and/or a just simply "VOW VCR". (Similarly to the "HOTV™ 

Local Network Affiliate (a "LNA"). The video with inserted Server", this client program is also called a "HOTV™ 

hyperlinks, ergo hypervideo, is variously received (by 35 Client" where HOTVM is a trademark of Tata America 

means .ranging from a transported disl ft networ nternatioc or\ n, assigt jf tl r «nt invention; 

communication) at a network video server, and is ultimately although this term will not be used within this specification.) 

served on demand to each client subscriber/user/viewer This VOW VCR of the SUV is described in the companion 

("SUV") upon a digital communications network by this patent disclosure for REAL-TIME RECEIPT, DECOM- 

video server. 40 PRESSION AND PLAY OF COMPRESSED STREAMING 

A next, third, related invention concerns the receipt of the VIDEO/HYPERVIDEO, WITH (1) DISPLAY OF PAST 

streaming digital hypervideo upon the network, and the SCENES, (2) RETROSPECTIVE HYPERLINKING AND/ 

display at each of potentially thousands of client subscribers/ OR RETROSPECTIVE RECORDING AS ARE BOTH 

users/viewers (client SUVs) of the received hypervideo and KEYED TO DISPLAYED PAS T SCENES, AND, WITH 

its embedded "hotspots" (which are visual manifestations of 45 SPECIAL SERVER SUPPORT, (3) DIVERSE VERSATILE 

hyperlinks). Selective volitional exercise of any inserted RESPONSES TO HYPERLINKS. The "SPECIAL 

hyperlinkfs) — the existence of which byperlinkfs) is (are) SERVER" referred to in the title of this related application 

made visually manifest to the SUV as hotspots on the video is ihe subject of the present application. Note that the 

imagery — by the client SUV is typically by action of the . "special server" supports "diverse versatile responses to 

SI V to i >in! id click" with a computer mouse, a so-called 50 hyperlinks". 

"click through". In simplistic terms, the related inventions may be con- 

A click-through on an embedded hyperlink by the client side red to concern (i) how to make fully group or 

SUV sets in motion the present invention, which is a community-customized and time-customized hypervideo, 

software-based process present upon a special network normally at an ICP/ISP/LNA, and (ii) how each SUV, or 

server. (This special server may, however, have other roles 55 client, may sense and may exercise hyperlinks within 

such as being a, or the, network/Internet content provider streaming digital hypervideo, while the present invention 

(ICP), video work service provider/interne! - concerns (ii) how the SUVs' exercise(s) of hyperlinks are 

service provider (ISP).) accorded, at the spec- •! sx rvc c (v hich may be the ICP/ISP/ 

The present invention is particularly directed to the cus- .' LNA), a fully customized interpretation, 

torn management of streaming digital video/hypervideo for 60 Accordingly, the related disclosures and this disclosure 

each single one of potentially thousands and tens of thou- may beneficial 1 together, 

sands of subscribers/users/viewers (SUVs) upon a digital 2. Particular Objectives of the Present Invention 

network communicating, inter alia, hypervideo. Each and The pre ■ nic hyperlink 

every client SUV may receive any of (i) video/hypervideo resolution, meaning that a hyperlink — no matter whether 

id :- record/storage 65 initially distributed to a small network community or an 

and playback/replay, (iv) controlled access to information entire nation, no matter whether recent or aged, and no 

(such as is commonly used to restrict viewing by children), matter with what (hyper) video "hot spot" os 
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ss ci ited — is not an invariant, inflexible and unchanging . directed to obtain a particular network resource, than the si 



link to, at ail times and by whomsoever exercised, a link to or the resource can support; other SUVs being delayed or 

the same network location, not to the selfsame identical ' otherwise routed, 

network resourc e, but thai, instead, ihe same hypervideo Hyperlinks thus interpreied are flexible, If some particular 

hyperlink, as and when exercised by each separate s hyperlink proves popular and often-exercised, then the com- 

subscriber/user/viewer ("SUV") is differently interpreted by mercial or other network resource accessed by the hyperlink 

a special server dependent upon (i) which SUV, exactly, is can be maintained. Any commercial or other network 

believed so have exercised the hyperlink, (ii) the economic resource that could have been accessed through and by a 

and/or accounts and/or credit status of the exercis mg - i 7, hyperlink that is never exercised need not be maintained, or 

(iii) the previously-expressed preferences of the SUV, (iv) 10 may be relocated to be accessed through some hyperlink that 

the time of day, week, month or year, (v) the proximate is exercised. 

exercise of the same or of related hyperlinks by other SUVs, . 3. Dynamic (Hypervideo) Hyperlink Resolution 

and (vi) still other factors. After the exercised hyperlink is so The present and related inventions go beyond the mere 

interpreted by the special server (which occurs in the generation, and th network dis ' ming igi s 

background, and without visibility to the SUV), then the is hypervideo, and custom hypervideo. The pre.se n< . in 

SUV exercising the hyperlink is caused (by this special in particular, permits that responses to any "click-through 

' server, and by software processes running at the client SUV) . (s)" made on any hypervideo link(s) by each and every 

to branch to a network location, or to access a network separate SUV may be fully customized. Moreover, these 

resource (which may even be a resource located locally at customized responses may be in consideration not only of 

the SUV hitnsclfVherself/itself!), in consideration of all the 20 static or semi-static data such as who the responding client 

factors of the exercise. SUV is, and what is known about him/her, and what time of 

The present invention thus contemplates the custom inter- day and day of the week it is, etc, etc., but responses may 

pretation and execution of hyperlinks "after the fact" of their also be dynamically formulated in consideration of the 

creation. This is part of the implementation of full custom "click-ihroughs" made on hypervideo links by all the SUVs 

hypervideo by ihe present and related inventions: each and 25 collectively. In other words, the present invention helps to 

every one of hundreds and of thousands of subscriber/user/ empower hypervideo by acting on hypervideo link requests 

viewers upon a digital communications network is, by and in a broad, substantial and versatile manner, 

large, (i) receiving common, or at most semi-custom, digital The manner in which the present invention works as is 

hypervideo hyperlinks (in accordance with a related follows. Although hypervideo may potentially be sent from 

invention), while (ii) any and all actions ("click-throughs") 30 the network hypervideo server to as few as just one 

on any hyperlinks are resolved in respect of when it happens. (watching) client SUV, the hypervideo, with its embedded 

from which SUV it happens, and even in respect of what is hyperlinks, normally goes out to many client SUVs in 

happening at other SUVs (i.e., the present invention). common as a "multicast". The hyperlinks may be inserted by 

Hyperlinks thus interpreted only when, and if, actually theICP,orby the VideoServer, or by the -ISP in consideration 

exercised by a specific SUV are thus susceptible of being 35 of the local community or group receiving the hyperlinks 

focused, and targeted, on the particular specific SUV exer- (within the hypervideo), the time of day, etc. For example, 

cising the hyperlink. That is exactly what the present iuven- hyperlinks that are (i) suitable to the perceived demograph- 

tion does; it makes hyperlinMng (within streaming digital ics of the (digital network hypervideo) audience, and/or (ii) 

hypervideo) specific to (i) the particular place (the SUV), localized to link (ultimately, indirectly, as next explained) 

and to (ii) the particular time of the hyperlink exercise, and 40 the commercials of a local merchant, may be "served up" to 

specific to (iii) still other factors. some portion of the network audience in common. However, 

Hyperlinks thus interpreted are always timely. Even if an the upstream hypervideo providers do not normally find it 

SUV was to exercise a hyperlink in a hypervideo recorded efficient to fully customize thousands of hyperlinks per hour 

■ some years previously, hyperlinking that is currently rel- going to each of thousands of individual client SUVs when 

evant will, in n teas* , till ensue. For example, suppose 45 only an infinitesimal fraction of the hyperlinks will ever be 

an ancient hyperlink that — when all the numbers of the exercised — even though they could so customize each and 

hyperlink's URL were interpreted—had really once been every hyperlink, 

only a indirect means of accessing a commercial of a local Instead, a single hyperlink at one spot in ihe hypervideo 

Ford automobile dealership was to be, during the playback may be, and commonly is, delivered in common to many, or 

of a recorded hypervideo, clicked after the lapse of some so to all, client SUVs. Instead of leading directly to the ultimate 

years. The dealership may have disappeared or have network site, Oi it in ately) be 

changed, and the advertisement originally accessible fiom accessed by the client SU % if he/she "clicks through" on this 

exercise of the hyperlink may have long since disappeared, hyperlink, the hyperlink instead points to a particular portal 

but it is entirely probable in accordance with the present of the special server, For example, to use the universal 

invention thai encoding of the more significant bits of the 55 resource locator (URL) notation of the world wide web, the 

hyperlink will always indicate thai this hyperlink is some- hyperlink might be to http://www.specialserver.com/car__ 

how related to the Ford Motor Company. Logically a link to , ford_ad_40. The client SUV does not normally see this 

a current Ford site, and current a Ford commercial, would be ' URL, nor exactly care what it is. The URL may in fact be 

served up to the hyper;; ! SUV— even if some nothing but numbers, and may effectively be indecipherable 

particular long past commercial was no longer extant. 60 as to exactly what response might be expected to be forth- 

Hyperlinks thus interpreted are rationally ordered and coming from any exercise of the URL, 

responded to in consideration of the interpretation of all As the sample URL suggests, a car advertisement from 

other hyperlinks Log c ne limited, desired, Ford (the fortieth one of such) is to be expected from the 

numbers of hyperlink-exercising SUVs can be, and will be, . client exercise of the sample hyperlink. Bui what 

declared "manners" of a contest or a lottery. Logically, no 65 advertisement, exactly? This is where the special server 

greater number of hyperlink-exercising SUVs will be con- combines the (i) identity of the responding client SUV with 

currently sent to particular network site, nor concurrently (ii) pre-existing data bases (that are in part maintained from 
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ths responding client " in good standing, the SUV will he fed a fink to the new video 

SUV not, most commonly, the final resource (the , stream (possibly uniquely out of all SUVs!) 

advertisement) but, instead, most likely, another URL point- Meanwhile, and quite remarkably, the old stream (the 

ing io the advertisement. For example, if the client SUV "mainstream") is also continued, and is still received and 

clicking on a Ford motor car hoispot is from a poor 5 stored (for so long as capacity allows) in the background at 

neighborhood, and/or has shown a proclivity for austerity in the subscriber/user. (See the companion patent dk 

consumption and/or aufomot:* n, then an The SUV may alternatively want, and may command by 

advertisement for a less expensive Ford automobile, and/or making a particular type of click on hyperlink (e.g., with the 

possibly one extolling economics of vehicular operation, right mouse button) or by clicking a particular on-screen 

might be linked for and to this particular client SUV. io control button, to commence recording — which may, 

Conversely, if the client SUV clicking on a Ford motor car remarkably, be done from a retrospective point in time — or 

hotspot is from a rich neighborhood, and/or has shown ' to, at a later time, stop recording. The recording will be 

proctivj: ks for conspicuous consumption and/or automotive stored locally for so long as capacity allows, which is 

consumption, then an advertisement for a luxury Ford typically not long (streaming digital video making volumi- 

automobile, and/or possibly one extolling the prestige of is nous use of memory), and will then be stored remotely upon 

{ d « rship n gbt bt inked for this partfc lar cliei the t hvo» f * nsidtr that the 

SUV. Clearly still more subtle distinctions are possible. This ' recording of the video stream that is being fed to any user is 

is called "targeted advertising", the benefits of which are really transpiring all the time, as it is for all the video 

well understood. streams, at the ISP/LNA (Indeed, if not a "live" video 

Accordingly, the special server acts to "hand off" the 20 stream, the video stream is normally stored at the ISP/LNA.) 

client SUV to a targe! destination/resource. This is com- The SUV "click-through" really serves but to send out to 

monly done by sending back to the client SUV a very, very the ISP/LNA a first time marker when recording is 

short and fast message containing a URL. The client SUV commenced, and a later time marker when recording is 

will then go out on the network to retrieve the resource at stopped. The SUV does not see, nor sense, this. When he/she 

this URL, wheresoever it may be and howsoever long it may 25 goes to replay the recorded video then the stored video is 

last. There is, of course, the possibility that the responding retrieved, either locally or from the common central store, 

client SUV (i) cannot reach the special server, or (ii) is and is replayed to the SUV exactly as if is was a full-custom, 

exercising an obsolete link portal, such as might occur if the or fully locally-stored, recording! 

client SUV is exercising a hyperlink on hypervideo recorded 4. The Objectives, and the Capabilities, of the Special Server 
some, weeks, months or years previously. There are many 30 of the Present Invention in a Network Hvpervideo System 
ways io deal with this situation, starting with the use of quite The network server of the present invention is a software- 
general portals (e.g., the http://www.specialserver.com/car_ controlled computer "server" operating in conjunction with 
ford) at the server and continuing with default hyperlinks 1) a video (or hypervideo) content server (a Network Con- 
(e.g., http://www.specialserver.com/default or httj * ' Content Provider, or simply an 
www.isp.com/noliak). 35 "ICP", and 2) a client (a "Video-on-Web VCR", or simply a 
The software processes of the present invention may be "VOW VCR") which is described in lot the conipauion 
present at any "special" service provider receiving, and patent application. The software-controlled computer 
acting upon, hyperlink "click througbs" auywhere within a "server" of the present invention is itself commonly called 
(hypervideo) digital communications system. An advertiser a "Video on Web Server", or simply a "VOW Server", 
pays the special server (and, or course, the ICP/ISP/LNA so 40 The objectives of the VOW Server system of the present 
that the hyperlinks are present in the first place) not just to invention are as follows. 

receive "click through" traffic, but, particularly in the case of 4.1 Multiple Sources of Multiple Hyperlinks all upon the 

the special server, so as to know more about the persons Same Hypervideo Feeds 

clicking through. This may be for purposes of, for example, First, the VOW Server system of the present invention 

follow-up mailings or e-mailings. Normally the most "intel- 45 permits multiple hyperlinks from t dtif if s turces to efiec- 

ligence" resides within the SUV databases at the special lively coexist simultaneously within the same hypervideo 

server, while the network resource providers (the ICP, ISP, feed. In crude terms, it permits multiple separate parties to 

and/or LNA) and the advertisers are quite "dumb". An get a "bite" at the SUV. This is because a SUV receives 

advertiser having a network site (a "web site") may, streaming hypervideo within which are imbedded hyper- 

however, choose to "play" a different advertisement at the so links arising from multiple feeds from separate sources. The 

same network site depending upon the day, and/or the time originator of the hypervideo stream, or network Content 

of day, at which the site is accessed through a hyperlink. Provider, or Internet Content Provider, or "ICP", adds the 

Accordingly, the special server of the present invention first hyperlinks. More hyperlinks may be added (by use of 

acts on aty s) made on any hypervideo the VOW Server system of the related invention) within the 

hnk(s) by any SUV in a network hypervideo system so as to 55 same hypervideo stream by a regional distributor, and still 

first interpret what in particular the SUV wants, and to then, more by a local network service provider (e.g., by an ISP or 

so far as is possible and authorized, to either give it to a LNA). If is crassly considered that all hyperlinks are 

him/her or, more commonly, to give directions to him/her as simple commercials — which they need not be — then it is 

to how to get it. parent that, as one way of describing the 

The SUV may want, ard a ay cc nt j nc >y naking a t lal atd regional and 
particular type of click on hyperlink (e.g., with the left local advertisements will constantly be present in the hyper- 
mouse button), to branch into a new (hyperjvideo stream. As video received by each SUV. 

long as the new stream is not forbidden to the particular SUV 4.2 Customized Hypervideo. Both Overt and Covert Via 

se of content previously restricted (at least at the ' Exercised Hyperlinks 

present time of day) by the SUV himself/herself (such as to 65 Second, the VOW Server system of the present invention 

control viewing by children), and/or because the selected • acts as a tool for the insertion of customized hypervideo 

video stream is pay-per-view and the SUV's account is not • commercials both overtly and covertly in the hypervideo 
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feed to each particular SUV. It will be understood that each ■ the winning numbers are pulled after the tickets are sold). 
SUV is receiving (network digital) video (hypervideo) on Many SUVs may get (from time to time, and in time 
demand, and need not, and commonly is not, in synchronous rotation) the same hyperlink, where a "caller number 19©" 
sequence with any other SUV. will win the car. In this case the network site— the special 

Moreover, in accordance with what providers at all levels s server— to which all SUVs clicking-through become routed 
want to send to a particular SUV — be the differential deliv- keeps b . ick of SUV responses, and identifies the winner, 
ery be based on anything from crude demographics to an 4.4 inset i 

exacting pert < jUV- he par- . Xes! Particularly as Exemplifies that Virtually 



ticular SUV will receive a variously customizea regimen oi ^ T f Information Can be Appended to Streaming 

both overt and covert commercials. Overt commercials are iQ n'^ s0 

tho in i i he SUV aiak s some effort, such as ~° J ~ . . 

"fast-forward" or branch on link, to avoid them. They are ^urth the VOW Server system of the present invention 

analogous to commercials on commercial broadcast teievi- P ermi5 f ; hat ™ taa «?* ^ of . ^formation can be 

sion appended, or hyperhiured, to streammg hypervideo at the 

The cover, commercials are. those that are present behind Ias£ > and concurrent with, or even after, hypervideo (with 

' the hotspots and associated custom hvperiinks (which need 55 contained hyperlink) distribution, 

not be exercised) that are presented to each SUV. Note that In accordance with a related invention, (l) pre-determmed 

or cither n ah" ypes of nercials the SUV rna) nd ceo change points, and (ii) the associated text annotations 

commonly does, branch on the network (at least for those scenes, as supplied within the streaming hypcr- 

temporarily) from a video (or hypervideo) stream originat- • video. (Text annotations are not hyperlinks, although they 

inp at the ISP , - iting at the 20 may be associated with hotspots and hyperlinks such as, for 

ISP or the LNA acting as the commercial provider. In other example, to give an textual explanation of the hotspot and 

words, when a particular SUV is presented a commercial associated hyperlink.) These (i) scene change points and (ii) 

from the Ford Motor Company, then he/she may have gotten associated text annotations are of importance in organizing 

the commercial from any of (i) the ICP, (ii) the ISP or the the display of the present and the historical hypervideo, and 

LNA, or (iii) even upon the communications network 25 hyperlinks, by the client SUV, or, more precisely, the 

(nominally, the Internet) from some site (some Universal "Video-on-Web VCR," software process running at the 

resource locator, or URL) at the Ford Motor Company, and ' Client SUV. These (i) scene change points and (ii) associated 

not from any network content or service provider! Quite . text annotations are sometimes predetermined by humans — 

simply, commercials can, in accordance with the principles who clearly do not perform this task in real time. This would 

of network communication, come from almost anywhere. 30 commonly be the case if the content provider was delivering, 

• The principle challenge is not how to deliver for example, a movie. The "scene change points" would be 

commercials, nor, for that matter, hypervideo itself. The related to major transitions in the movie, and all annotations 

main challenge is how to deliver commercials intelligently, could be carefully drafted. 

and to good effect, without alienating the SUV from she However, the (i) scene change points and (ii) associated 

commercials, or, in extreme cases, the medium (the digital 35 text annotations may alternatively be determined, and, in 

communications network) of their transmittal. accordance with the related invention, inserted into strearn- 

4,3 Dynamic Hyperlink Resolution as Supports, Inter Alia. ing hypervideo, in real time! This would be typical, for 

Network Lotteries and Coupons Distributions example, of a live news transmission. The simplest "scene 

Third, the seeded hyperlinks are resolved at run time. Any change points" 3re readily detectable by machine process 

and all of the servers along the distribution of the video 40 from changes in the scene images. The (ii) associated text 

stream to the SUVs may intentionally insert links that have annotations may be provided by anyone from a stenographer 

■ results that are, to the SUVs and to any individual SUV, any to a voice recognition program to a "canned" schedule of the 

of unexpected, randomized, and/or chance. These links are news program, much in the manner of present-day captioned 

resolved at run lime when a SUV clicks on objects in video television. The (ii) associated text annotations can be ornit- 

(including advertisements), and thereby determines the link 45 ted without deleterious effect other than the attendant loss of 

destination to which the SUV's VOW VCR agent will go. the associated information. 

This process is referred to as "dynamic hyperlink resolu- Although (he (i) scene change points, and (ii) associated 

tion". This concept may be used, among other important text annotations, have a very logical, and elegant, purpose as 

purposes, to implement a "lottery" or "coupon" system in is discussed in a companion patent application, their impor- 

commercials in a manner hitherto unseen in either streaming so tance in the present invention is as an indication of the 

video or television media. tremendous flexibility of the VOW Server system of the 

Note that this "dynamic hyperlink resolution" can be invention in inserting just about any nature or any type of 

implemented in many different ways. A unique hyperlink information whatsoever into streaming hypervideo. Clearly 

may be distributed to one, or to a few, SUV. The entire SUV it is equally possible, to insert in real time any of (i) captions, 

audience may be told to "click on the new Ford" and "if you 55 (ii) music, (iii) commentary, or (iv) control codes into 

see a red star then please click through because you have responses made to SUV ciick-throughs on hyperlinks within 

won a new car". The SUV audience is then further told "but streaming hypervideo by use of the VOW Server of the 

if you don't then please click through to see our Fall bargains present invention. 

anyway". (To prevent automated, or hacked, interception of Bu*, con I > types of hyperlinks and 

winning "codes" by SUV-installsd software filters, the "red 60 hyperlksking may be made mandatory, and need not be 

star" may be a one-time symbol, or symbol unique to an subject to "point and click" by the Client SUV in order that 
individual SUV, and not publicly known.) The class of hyperlinking should nsue fhis means thai the same (i) 
dinner is b ii efo the fact (of captions, (ii) music, (iii) commentary, or (iv) control codes 

the distribution of winning "tickets", much like lottery may be, by use of the present it « lively inserted 

scratch-off tickets). 65 into, or linked so as to effectively become within, streaming 

Alternatively, the class of potential winners may be iden- digital hypervideo after the fact of the multicast of this 

tiffed after the fact (much like regular lottery tickets, where hypervideo. 
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This is exactly how (hyper)steaming video is enabled to The considerable importance of the present invention in 

incorporate functions taken for granted on (modem) televi- the context of security is a follows. A capability for strong 

sion. For example, an uneiuninatabie unavoidable always- positive transactional control is clearly inherent in any 

Jh possible,? t *vere network transaction where each party is certain as to who, 

weather warning (i) message, and/or (ii) a warning tone, s and only who, is at the other end of a communications link, 

may be inserted" The steaming hypervideo receives is then At the present time, this control is established by forming a 

(to the extent that it runs through these mandatory point-to-point secure link, typically encrypted, th securii 

hyperlinks) always a "weather radio"; it simplv gets a null if which i >s \ slid only so lone as iht i i - atait 

message, completely opaque to the SUV, most of the time. (These links are typically presently used in Internet 

If a real emergency arises no (hyper)video nor any hyperlink . n commerce.) 'Hie problem arises when, in the world of the 

needs be suddenly inserted into the hundreds of different : nearly infinite branching possir es of b links, a secu- 

(hyper)video streams being watched by the thousands of rity feature roust be offered or enforced at a time later than, 

■ SUVs; hyperlinks already leading to previously dormant and possibly very greatly later than, an occurrence upon 

messages may already be present. When the emergency which the security function will be predicated, 

arises, the hyperlinked message on some message server The basic solution to this problem is what cryptologists 

becomes no longer dormant, and "plays" at the SUV. 35 refer to as the "one time pad". Party A gives party B a unique 

Video (hypervideo) presentations — such as, for example, . number which is good to transmit (or to predicate) infor- 

of a state funeral — may be "back dropped" with (iii) com- maiion in the future but one time only. Once the unique 

mentary both audio and/or textual, which commentary may number is used once for information transmission from B to 

be viewed and/or heard or else suppressed by SUV prefer- A, then it is forever discarded. 

ence. 20 In the context of streaming hypervideo, the implcmenta- 

Still further for example, a (iv) logic bomb— which for all tion of a one time pad is straightforward. For each and every 

digital technologies is in fact no more than simple pro- network security event prospectively in the future to be 

grammed directives— may be sent to a non-paying SUV. presented — and even those events that will never be, in fact, 

Each of these separate scenarios, for separate purposes, is broached by every SUV— timely issue to each individual 

worthy of considerable though' and analysis. Suffice it to say 25 SUV a unique number (which may, but need not be, be in 

only that there is some "control", and potential control, ' form of a unique URL) for each event. If the "right" SUV in 

going on over the network and inside the streaming digital the future comes to have the "right" number, then a security 

hypervideo. This quite unlike the world wide web, where filter is satisfied, and not otherwise, 

each client with his or her browser goes when and where lie The challenge is clearly to give every single SUV a 

or she will, willy rally. Instead, there is some degree of 30 stream, which may be a copious stream, of unique numbers, 

directivity,, and potential latent directivity, "built in" to the Generation and management of the numbers is no big 

delivered hypervideo. problem; distributing them to the SUVs is. This the present 

4.5 Security in Networked Distribution of Streaming Hyper- ' invention makes possible. 

v id eo 4.6 Monitoring, Accumulation, and Use of User-Subscriber 
Fifth, the VOW Server system of the present invention 35 Information as Represented by User-Subscriber Click- 
supplies security information to the client, or the "Video- Throughs 

on-Web VCR". Such information may include whether or Sixth, the VOW Server system of the present invention 
not a particular SDV has the authority to record a particular permits the gathering, and the accumulation, of valuable 
clip or not, or whether or not the SUV can jump to a information regarding each SUV entity, regarding SUVs by 
particular clip via a hyperlink or not. This is similar to, but 40 groups that are regional or otherwise, and by all SUVs taken 
distinct from, the prior art pay-per-view situation where the together. This is accomplished by recording SUV click- 
remainder of a show can't be seen unless paid for. tbrougbs and using this recorded information to develop 

As with the dynamic hyperlink resolution, the security both personal, group and collective SUV statistics, 

information may be qualified either, or both, before and after These and other aspects and attributes of the present 

ths 1 cl Consider tb< following example. The "Jones" 45 invention will become increasingly clear upon reference to 

household with children has registered with its network the following drawings and accompanying specification, 

service provider to decline notification of any "R"-rated BRIEF DESCRIPTION OF THE DRAWINGS 

pay-per-view offerings. When an advertisement for such an , , . 

offering, or a hyperlink to a preview of such an offering, is \ » » diagrammatic view of the origin and transfer 

issued out to SUVs in the SUV base, the "Jones" household so of *P EaI vufeo/bypervideo data upon a digital network to 

will not receive either. The "Jones" household will, however, . multiple , subscrxbers/users/viewers (SUVs), indudxng 

receive an advertisement and/or accompanying hyperlink to *™&< b V , ™V , °! r enm ? te : ™ tate ^ ?™ 

a"G"-ratedpav-per-viewoffering.Ala S ;ihehy P erlinkleads, (W « » ^*»> Network Affiliate (LNA) acting as the 

again by prior-stated preference of the Jones household, not ess ^ s P 6Cial 5 s ™ OT V ,°W Server, where hyperlinks 

7 the preview, but rather to a security filter requiring 55 w!hin hypervideo are resolved in accordance witn .he 



entrance of a password. Little "John Jones", not having the 
password, might as well keep on with his (streaming FIG. 2 is - a lock diagram of the major s * 

cor ponen s c he VOW Server < is e >m nu icates across 
password and enters viewing of the preview. When after * e oetwoi ' '■ at SUVs) m the preferred embodt- 

viewing the preview, however, "Jack Jones" decides to 60 nieni of the present invention. 

immediately partake of the pay-per-view offering, and clicks FIG. 3a is a block diagram of the production of 
through in an attempt to do so, then the pay-per-view server hypervideo, containing both (i) hotspots and (ii) associated 
knows from comparing Jack's entrance code— previously . hyperlinks, at an authoring sta itent provider 

provided uniq c server or.c time at the earlier (shown in FIG. 1) the preferred embodiment system of the 

start of the preview— to the credit list for all codes that Jack 65 present invention. 

has not paid the Jo s's last bill, and must receive a dunning FIGS. 3b through 3d are block diagrams of the control and 
message instead of the desired pay-per-view offering. data exchange between the VOW Server/Internet Service 
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Provider and the Ciient SUV in the preferred 
the present invention. 

FIG. 4 is a pictorial representation of a screen shot such 
as might be seen on a monitor of a Client SUV ja the system 
of the present invention, which svstem was previously seen 
in FIGS. 1 and 2. 

FIG. 5 is a schematic view of the architecture of a portion 
of the preferred embodiment of a system in accordance with 
the present invention (as was previously diagrammatically 
' shown in FIG. 1), the portion including 1) a video server, 2) 
a network "video on web" control sewer (the "VOW 
Server") which is commonly, and by way of example, 
located at a network service provider (the "ISP"), and 3) 
multiple "video on web VCRs" ("VOW VCRs") of Client 
subset sbers/users/Viewers ("SUVs"). 

FIG, 6 is a diagramm.ilu: \ 1 
SUV whose VOW VCR is playing hypervideo may click on 
a hotspot to branch to a network page display, or "web 
page" 



FIG. 7 is a diagrammatic view illustrating that is Client 
SUVwf h s ' U V \ - playing hypervideo may click on 
a hotspot to alternatively branch to another video, or hyper- 
video. 



large, the video/hypervideo he or she wants when he or she 
wants it — much in the manner of "surfing" the sites of the 
world wide web — but also that some sites or sites upon the 
network — to'inn ] 
5 Internet Service Provider (ISP) — come to know a great deal 
more about what, and when, the Client SUV is viewing than 
heretofore. This knowledge is not gained by any sort of 
insidious monitoring of the Client SUVs. Instead, it should 
be recognized that the Client SUVs from lime to time 
io identify, and link, to the (hyper)video that each wishes to 
view, ft is simply necessary to set up a network structure 
where these Client SUV choices can be assimilated, 
catalogued, and, optionally optimally, acted upon. This, the 
present in* ition - i rutting (i) the ready 

15 gathering of Client SUV "interest" data as is expressed by 
"click-throughs" on hypervideo hotspots having associated 
hyperlinks, and (ii) the use of the cumulative data so 
gathered to at least partially, and/or from time to time, 
predicate the issuance of, and/or the branching (linking) in 
20 respect of, further hyperlinks later in time. There is thus a 



trade: the Client SUV, as an inevitable 
"surrendering" interest information, permits thai this infor- 
mation should be reasonably, and intelligently, interpreted 
and acted upon so as to shape, if not the future viewing 
FIG. 8 is a diagrammatic view illustrating that a Client 25 experience for the Client SUV (i.e., for purposes of 
SUV whose VOW VCR is playing hypervideo may click on propaganda, or pandering to Client bias) the future com- 
a hotspot to alternatively branch to, by way of example mercial offerings to the client (i.e., salesmanship). The result 
among many different network resources two of which have is generally favorable, to both Client SUV and network 
already been diagrammatically illustrated in FIGS. 6 and 1, advertiser: the Client SUV is ultimately absolved of watch- 
a slide show. 30 ing "commercial" in which he/she has no interest, or is even 

FIG. 9 is a top-level software flow chart of the VOW hostile, and is instead presented, at least in part, with the 
Server of the present invention, by which software a Client focased and targeted information, albeit often commercial 
SUV hyperlink "click-through" request is dynamically ' information, that busy lives require, 
resolved 0ne related invention particularly concerns how, 

FIGS.'lO and 11 are second-level software flow charts of 35 both . ©. * deo hypervideo clips, typically 

the sequence of processing the Client SUV hyperlink "click- containing advertising, and (u) hotspots and associated 



through" request in the VOW Server of the present inven- 
tion. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 
1. Context and Environment of the Present Invention 

It being assumed that the SUMMARY OF THE INVEN- 
TION section of this specification has been read, this first 



hyperlinks, which hyperlinks commonly lead to advertising, 
may be inserted, if necessary on-the-fly, into streaming, 
compressed (normally MPEG compressed) video. Note that, 
40 in the vernacular, both (i) commercials and (ii) hyperlinks to 
commercial may be inserted, and commonly (at least for 
sponsored programming), both are. The insertion, and the 
management, of hyperlinks is separate from, and is different 
than, and should not be confused with, the fact that video 
paragraph of this section focuses on the larger systems 45 and hypervideo clips may also be inserted as (typically 
environment in which the special server, and the dynamic periodically scheduled) commercials within the streaming 
hyperlinking processes, of the present invention, are opera- hypervideo. In accordance with the related invention, both 
live. The present and related inventions contemplate com- insertions may be done on-the-fly and while the hypervideo 
puter systems and software tools that can automaticaEy: 1) is streaming, and compressed (normally MPEG 
analyze an incoming stream of video for scene changes in 50 compressed). 

real-time; 2) cut/copy/paste from/to the video, including so Hyperlinks (such as are commonly associated with 
as to insert hotspots over inserted hyperlinks, thus making commercials) are, of course, distinguished from embedded 
hypervideo; 3) delivering the hypervideo upon a digital (video and hypervideo) commercials for, inter alia, the fact 
communications from a hypervideo server to clients, where- that an embedded commercial will normally inevitably 

upon the clients may "click on" hotspots in the moving 55 unfold unless action is taken by the Client SUV possibly 

hypervideo to hyperlink; 4) resolving the clients' hyperlink- by clicking on a hyperlink!— while hyper] inked conamer- 



a special network server so that 5) the clients may 
ultimately branch as desired between network resources 
including hypervideo, 6) recording as desired any sequence 
thereof so as to build as desired a mosaic or album of 
interesting scenes. The present invention — which more par- 
ticularly concerns functions 4) and 5} — is thus but one 
aspect of a more extended system, and concept. 

The overall system could be called, and considered to be, 
"full performance h\r " u < performance" not 

only means that a Client subscriber/user/viewer (SUV) upon 
the digital hypervideo distribution network retrieves, by and 



cials will not normally unfold (i.e., be seen) unless specific 
Ciient SUV action is taken to click on a hyperlink. 

Of course, in the networked real-time world things need 
60 not, and are not, always what they seem to be, The classic 
case oi t is al, corresponding to the 

existing "station breaks" on network television where are 
inserted commercial messages from the local affiliates. 
Things get complicated when it is remembered that the 
65 video feed to the Client SUVs — insofar as there is one, or 
ten, or a hundred sucli — may have come to the ISP by 
satellite overnight, and the ISP is really both "station" and 
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"network". I should be understood that, in accordance with multicast, then at the same time) until a scene break near the 
the present and related inventions, commercials can be nine minute elapsed mark. On ; k bandwidth is 
"inserted" into network-distributed digital hypervideo, and required. Some Client SUVs then receive 30 second corn- 
video, in many places, and at many times— for even the mercial A, and then pick up with the video. Other Client 
same video content! It is not so much a challenge of how to ■ s SUVs continue in t j deo frypervideo until near 
get the commercials into the network distributions, but how . the len mkmt& mark * ^ then receive 30 second commercial 
to get them in so that digital net* I u>i - a B > nen P><*mg up dgvn with the video/hypervideo. Finally, 
"vast wasteland" ascribed to television. still other « 3» it SUV contii ue in the program video/ 
It must in particular be considered that even the "regular" hypervideo until near the eleven .minute mane, ana then 
scheduled, commercials, can be accessed by hyperlinks, and 10 reccivc 30 ^°f r ~'T I J- CQnd ™ ° f 
hyperhnkin? • Th«c regular commeiu , s ( dtQ { ^ hM ~ m ui 
considered to be accessed by hyperlinks which when m £ to 3x from ^^.^ nine mimite5 E0 e \ yen 
amved at witmn a streaming hypervideo, have a 'default ciKUles < . 
mode which will cause hyperlinkmg unless the client does j, a( .„ 

something to the contrary. The client customization ability is 0 f course, in accordance with the present invention, the 

of the present invention is thus useful in both (i) the "force "insertion" is not of clips— as was postulated to be the case 

feeding" the client customized commercials, as well as (ii) with the ICP and possibly several other places upon the 

I he customizing of any information (commercial or network—but rather of hyperlinks. The inserted hyperlinks 

otherwise) that the client may volitionally seek by clicking point, c < < -ii server can 

on a hyperlink. 20 be the ISP itself but, for purposes of alleviating congestion, 

In its ability to manage hypervideo hyperlinks so that . it may also be another, separate, server upon the digital 

hyperlinking is customized, the present invention is of use to communications network. 

TV, cable and internet service providers (ISPs) who provide Wheresoever physically located, the special server — and 

and/or who insert into streaming video (and hypervideo) the commercially valuable information that accumulates at 

advertisements, and/or hyperlinks to advertisements. 25 ibis server regarding the ISP's clients — is normally con- 

The best way of thinking about the present and related trolled by the ISP. However, this special server can aiterna- 

iaventions is to completely abandon the idea that there is but lively be controlled by something like an advertising agency, 

one information source, and multiple parallel information and the ISP is simply paid a flat rate for its services as a 

sinks — as in broadcast television — and to instead realize that common carrier, or, at most some fee based on how many 

upon a digital communications network information flow 30 and how pliable are its Client SUVs as can be both (i) 

control may be separated from information content, and that periodically "fed" commercials, and, wondrously, (ii) occa- 

all sorts of information resources are "coming and going" to sionaliy be induced to volitionally access a commercial and 

and from everywhere, and not necessarily concurrently, nor even (iii) buy in response to a commercial, 

in linear time sequence, between all servers and all clients — Accordingly, and in accordance with the present 

much as the Internet functions today. 35 invention, hyperlinks that are eventually resolved to link to 

Network content providers, or Internet Content Providers, (typically local, typically focused) commercials are inserted 

and/or ISP's may, in particular, insert "hard", linear, video . by the ISP, and are resolved by the special server at the 

clip commercials in video/hypervideo of their origination — running time of the hypervideo tendered each Client SUV. 

although even this may not be a good idea if the program Note that the special server does not, within a reasonable 

content is to be later "re-shown" (a better term for a network 40 window of some days or weeks, care exactly when this 

may be "reordered outside of anticipated tirne-of-viewing transpires, and exactly when the hyperlink must be, and 

parameters"). finally is, resolved. 

Network Service Providers, or Content Service Providers, The commercials ultimately resolved at the special server, 

and/or ISPs may, in particular, control the immediate video and then accessed (from .-pa sv 

servers from which the network Client SUVs directly obtain 45 by the Client SUV may be (i) static "web pages", (ii) regular 

video/hypervideo — although certainly not all the same video so as to create a relatively non-invasive commercial, 

video/hypervideo, nor invariably synchronously, Indeed, or (ii;) bypervideos which, although leaving the commer- 

some client SUVs are typically delivered multicast video/ cials non-invasive, makes the commercials interactive, and 

hypervideo, while others may be completely asynchronous. ' potentially exciting for the user. Namely, the user can click 

The video server might be considered to hold and store, for 50 in the hypervideo commercial to initiate a web transaction or 

example, 48 hours of programming for 16 channels, deliv- to make a purchase. 

ering any and all on demand of an individual client. The ISP From such feedback as may be gained (typically, but not 

inay well desire to "inseEt" local commercials automatically exclusively, at the special server) by user-viewer(s) "click 

at scene transitions as video broadcasts flash by (from either throughs" on inserted hypervideo commercials, subsequent 

live camera feed or video servers), seamless" r f 55 on-the-fly common ! a(s) mav to be tuned to 

the video/hypervideo with its "inserted" advertisements to local demographic conditions and user profiles, or, 

the client subscribers/users/viewers of the ISP. preferably, even to an individual user-viewer. 

In accordance with the present and related inventions, in 2. The Mc , and Custom 

order to (i) maximized the network economies of I > x i s/UscrsA ( f is on 

multicasting, while concutrentiy (ii) delivering custom 60 Hyperlinks 

ireials, commercials may be delivered to the various The present invention contemplates an interaction 



Client SUVs otherwise watching the same video/hypervideo between, and a c , 5io < i o o >, ) res 

igbily differ* , it example hyperiii ks in to d t-c feeds, and (ii) a sub- 

for purposes of illustration, the network bandwidth is 3x and scriber's recent activity in pursuing hyperlinks embedded in 

to deliver a video/hypervideo 65 hypervideo. 

content, and Ix to deliver a commercial. All Client SUVs In simplest terms, a particular subscriber may have vol- 

commonly receive the same multicast video/hypervideo (if untarily volitionally "clicked through" a video hyperlink (it 
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does not matter whether the hyperlink appears in a program ' of the stream to be inserted, and a minimum number of video 
orinacomniw ! - i oil w i 1 id indirectly units after which this insertion can take place, 
(in accordance with the present invention) a hyperlink to, by ' Both the primary programming) - \m the Internet Content 
way of example, an automotive manufacturer. It may thus be Server that provides the MPr"; i e sec ondary 

logically imputed that the subscriber is, at leas! momentarily, s programming (from the client SUV's Internet Service 
interested in cars, or in a particular car. The automotive Provider) can, and typically do, offer the Client SUV a 
manufacturer whose site was visited would logically desire choice of multiple programs is t s. The Client S 
to re-visit the subscriber with commercials. For that matter, ■ can select a channel for ensuing playback from, and within, 
other automotive manufacturers, worried that an interested either the primary programming of the secondary program- 
er might be sold an automobile by the competition, 10 ming. In this regard the Client SUV's control is not much 
would also like to immediately get their advertisements to different than television, where a channel can be changed 
the attention of the subscriber. This process simply amounts during a show or during a commercial 

Note that the Client SUV'-selecied "channel", or MPEG 

In accordance with the present invention, a parly on the stream containing programming, and be another "channel" 
network, normally the special server (which may be, but is is or MPEG stream, or the same Internet Content Server thai 
not normally, the network communications service provided the first MPEG stream. This is very common. Hie 
wovider) f ughs" of SUV is offered, or enticed, to go from a more general to a 

the subscriber. This much alone is no! very profound. mote specific channel, or to go from one providing enter- 
However, being able to do something the monitored "click . tainrnent and/or education (so as to attract the Client SUV in 
throughs" is. 20 flic first place) to one providing such commercial feed as the 

fa accordance with the present invention, (hyperlinks to ' Client SUV has, by his channel selection, indicated that 
ultimate, (i) video clips, and/or (ii) hypervideo clips, and/or he/she is willing to view. However, the successive main 
(iii) even more hyperlinks, will immediately, and likely "channels" selected for playback at the Client SUV end need 
nearly incessantly, be seamlessly fed back to a client not be of the same Internet Content Server. In other words, 
subscriber/viewer/user once, and, importantly, yet again if 25 more that one "network" may sometimes be received on, and 
(by hyperlinMng) the client SUV permits. This concept is from, a single Internet Content Server. Why should this be 
important. The special server of the present invention is not so? It is because if the SUV's Internet Service Provider does 
only a wise (and a patient, and a tireless, and an ever not provide him/her with the "channels" that he/she wants, 
vigilant) "salesman", it is an incredibly persistent "sales- then the Client SUV will likely soon have a new Internet 
man", A client SUV will tell it that he/she is interested in 30 Service Provider. This various MPEG streams as comprise 
something just once and will thereafter not likely lack to be the "channels" are always available either locally or as 
urnisl ii >> t ttion about it again and again. specified by a URL pointing to a Content Server. 

In the extreme, a client SUV may click but once on, for Accordingly, under processes of the present invention, the 
example, but one auto advertisement in the morning and will Internet Service Provider can feed the Client SUV-selected 
thereafter be lucky if he or she sees anything but endless 35 MPEG stream to the Client SUV for p - i 5 
auto and auto dealer advertisements dynamically hyper- Service Provider can access, and can initialize for insertion, 
linked into received streaming video programming all the all secondary streams specified in the Insertion Schedule, 
day long. This process amounts to "focused advertising". The internet Service Provider can seamlessly insert second- 
3. A Server of DiQital Video Clips, Particularly Advertise- ary streams within the main programming stream in the 
ments 40 order, and at intervals, specified in the Insertion Schedule, 

A server of digital video clips, particularly feeding all such streams to Client SUV for playback. The 
advertisements, can access MPEG streams, available either Internet Service Provider can receive requests from a Client 
(i) locally or (ii) by a Universal Resource Locator (URL) SUV to hyperlink to related videos, which are available 
pointing to a server of clips (an Internet Content Provider of either locally or are specified as a URL. The Internet Service 
sorts). The server at which the clip (the advertisement) 45 Provider can access hyperlink video streams, initializing 
(optionally) resides may, or may not be, the same Internet . these streams and feeding them to the Client SUV for 
Content Provider that provided the MPEG stream, or the playback. 

same video/hypervideo server that distributed the stream. On completion of a hyperlink video stream, Internet 

Normally the server of advertising clips is separate from Service Provider can automatically and seamlessly switch to 
both. It may be, and commonly is, associated with the 50 She earlier playback stream, and can continue sending the 
advertiser (or his agent, the advertising agency). new stream from the hyperlink point. The Internet Service 

Normally, the Internet Content Server that "provides the Provider can accept successive requests to hyperlink, thus 
MPEG stream also provides, as part of all of the "price" of forming a hierarchy of video streams. On completion of a 
receiving the stream, commercials, including embedded video, the Internet Service Provider can switch and return to 
hypertext ,md hyperv;;-- > s < £"bulded within 55 playback of the video at the earlier, higher level. 

Uuurni p t i it < t u idvoidabli ^ r it I 1. i jo I iteniet Service Provider can reset and ins- 

Client SUV. This Internet Content Server that provides the tialize all component modules on receiving a close request 
MPEG stream still further specifies, and embeds within the . from the user-viewer. 

MPEG stream, an insv..- < ."sertioa of sec- These and other performance characteristics of the system 

ondary programming within mam, user-selected program 60 arid methods o: the iconic ii 



ming. The ISP, and/or the video server, may use this inser- iagly clear with the explanation c 

' tion schedule. Any secondary programming — typical.*, in 3 4 of this s caseation 

the form of MPEG streams as the user-viewers are typically 4. The Client Subscriber/User/Viewer 

but poorly responsive to static displays — is again available In accordance with the present invention, the Client 
eiitiei locally or remotely as specified by a URL. The 65 subscriber/user/viewer (SUV), or simply Client, is offered a 

insertion schedule typically consists of entries for each choice of multiple programming channels. One channel can 

n instance. Each entry specifies the access path name be, and is, selected for playback. The Client SUV thus 
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conveys back to the Internet Service Provider of the Local There is the possibility of (i) no action on a Client SUV 

Network Affiliate (that is also the Advertisement Server) the • click-through to the special server. There may be no 

primary progr Client SUV connection, or no video/hypervideo hot any further link 

f >r vh wing. Immed ell ISP/LNAcan tailer the adver- available at the connection, or the hyperlink may simply 

emems let provided to (i) w ho the SUV is (or at least s intentionally be null, 

appears to be) and (ii) what the Client SUV has currently There is the possibility of (i) delay at the special server in 

chosen to watch. response to a Client v lie s >ecsal server, 

The Client SUV synchronic % th tht ISP E NA (or nk would be 

Advertisement Server) for reception oi: the user-selected resok JSV AUboup 

primary Fogramming channel Qicnt SUVs are not expected to like greatly delayed 

ne; Caen St;v p;avs »3cx ah programming receivea . ■• , • „ <"L „ ■ ,i„,„j ,,,,, . 

from the video server an MPEG stream Additionally, any res P OE,ses t0 ch f ckm S 0f! ho **°*' U 55 contemplated that a 

and ali advertisements and messages from wheresoever response can, necessary std be tssued after some tens o 

upon the network received are inserted by the Client SUV de!a V- ^ Client continues ,n the past 

into the primary programming cha 1, and are vrdeo-hypervideo m> - .«nn. _ 

also seamlessly played back 3 5 1156 computer system of the Client SUV can receive trom 

The computer system of the Client SUV -called a Video video/hypervideo server, and can play back, a new video that 

on Web VCR, or VOW VCR - -can detect video scene was selected though resolution of a hyperlink within the 

changes in real-time; as video is being fetched and played original, hybrid, programming stream, 

back all scene transitions can be flagged automatically, and The computer system of the Client SUV can playback a 

boundary frames for a scene noted. . 20 nested succession of videos; each video appears as a hyper- 

The computer system of the Client SUV can generate a link within the earlier, higher level video. Upon completion 

representative frame (also known as a keyframe) for a scene of a video, the computer system of the Client SUV can 

as delimited by its start and its end frames. seamlessly continue to playback the higher level video. 

The computer system of the Client SUV can cache in On action, the (human) Client SUV can close the con- 
temporary storage a portion of video being fetched, and can 25 nection with the video/hypervideo server and can thus end 
subsequently playback this video from cache buifere. ongoing reception of the hybrid programming stream. 

The computer system of the Ghent SUV can start record- These and other performance characteristics of the system 

ing digital video from the current play position, as a valid and methods of the present invention will become increas- 

MPEG stream; and can stop recording when desired. ingiy clear with the explanation commencing in the next 

The computer system of the Client SUV can start record- 30 following section 5 of this specification, 

ing digital video, as a valid MPEG stream, from the start of 5. System Description 

any scene cached in temporary storage and represented by a FIG. 1 is a schematic block diagram of a digital hyper- 
keyframe. Recording will continue, saving all video frames ' video communication system including the special dynamic 
in cache as well as any new video frames being stored in hyperlink-resolving server, called a Video on Web Server, or 
cache, until slopped by Client SUV action. 35 VOW Server 1, in accordance with the present invention. As 

The computer system of the Client SUV can receive and such, FIG. 1 diagrams the total content delivery environment 

playback hybrid streams — primary programming inter- in which the VOW Server I operates, 

spersed with advertisements — that contain hypervideo infor- Live content 2 is produced by network content providers/ 

mation. producers 3, and is delivered onto the digital network 4 by 

The computer system of the Client SUV can decode 40 the Internet Service Provider, or "ISP", 5. The content 2 is 

hypervideo information in the hybrid stream, and the delivered by the ISP 5 onto what may be considered a high 

(human) Client SUV can mark pre-authored objects of - speed communications "cloud" in the form of the network 4, 

interest in playback video. and this content 2 is consumed by client subscribers/users/ 

The computer system of the Client SUV provides visual viewers, or "SUVs", 7, most of whom are typically home 

cues to indicate an" object of interest in a video as "hot" and 45 SUVs. The ISP 5 in turn receives this content 2 from content 

thus selectable, providers/producers 3, either live or on stored media. The 

The computer system of the Client SUV can take a ISP 5 broadcasts this content 2 as live content or else makes 
predefined ' action when an object of interest has been it available in stored format, on the video server 9. The VOW 
selected by the (human) Client SUV, typically by act of the server 1 inserts local, rich, interactive commercial content 
(human) Cli< he c-isect A typical 50 using the dynamic hyperlink resolution and dynamic hyper- 
predefined action would be the playback of a different video, linking method of the present invention, 
or the playback of a different segment from the same video During delivery of content 2 onto the network by the ISP 
or a connection to an Internet web site using its Universal S, the delivered hypervideo is stored upon the video server 
Resource Locator (URL), or, as is most pertinent to the 9 and delivered on demand to the SUVs 7. The delivery may 
present invention, a link to a particular, addressable, portal 55 be in any part multicast (meaning to more than one SUV 7 
of the special server. at the same time). The deliver}' is by definition multicast if 

If accessed, the special sever will typically return to the the hypervideo content is from a live video feed. Hotspots 

computer system of the accessing Client SUV a video/ and associated hypervideo links, or hyperlinks, are always 

hypervideo to be played, or, more commonly, a URL point- first delivered in the streaming hypervideo from the video 

ing to a video-hypervideo to be requested and obtained 60 server 9. 

across the network, and played. Thus the predefined action The hotspots and associated hyperlinks, which are typi- 
c ^ '.i6 the playback caliy links to advertisements or advertising-related promo- 

of a different video/hyper eo !! I pec lai server directly tions (directly, or indirectly in accordance with the present 

issues the "playback" video/hypervideo, then this "play- invention the explanation of which is ensuing) may be 

back" video/hypervideo may be accessible to the special 65 inserted either into stored, or into live, video content 2. Of 

server either locally, or through a Universal Resource Loca- course, if inserted into live video then the hotspots and 

tor (URL) or an Internet Content Server. associated hyperlinks have to be so inserted in real time. A 
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companion patent application for REAL-TIME TAR- authoring system of the related patent application, to modify 
GETED INSERTION OF VIDEO CLIPS, HYPERVIDEO a video stream, the MPEG stream 21, to produce and 
CLIPS AND/OR HYPERLINKS IN COMPRESSED authored MPEG stream auth.mpeg 22. The authored stream 
STREAMING VIDEO, INCLUDING DYNAMICALLY AT auth.mpeg 22 contains both ■ ii) associated 

MULTIPLE POINTS BETWEEN CONTENT PRO VI D- 5 hyperlinks. The (ii) associated hyperlinks are of two types: 
ERS AND SUBSCRIBERS IN DIGITAL NETWORKS a 1) first, or static, type and a 2) second, or dynamic, type, 
teaches how this is done. The hot links and associated FIG. 3h through FIG. 3d illustrate the basic mechanism of 
hyperlinks may be inserted into hypervideo that goes to as the dynamic hyperlink resolution, and dynamic 
few as one single SUV 7, or into hypervideo that is multicast hyperiinkicg, process of the present invention, 
to many SUVs 7 at the same time. In other words, any ao Referring to FIG. 3b, a second step is consent delivery, 
individual Client SUV may rarely be receiving hyperlinks The client SUVs 7 stream in the video auth.mpg 22. If the 
that are custom (if not also hotspots that are also custom, link is of type A, client directly goes to the specified URL. 
which is rarej still.) Normally, however, in accordance with If the hyperlink is of the first, or static, type 1), then the client 
the present inventio i . Client SUVs, especially those SUV 7 goes directly to the URL specified by the hyperlink. 
1 r td f. k i i d r t y s it 3 I i it s i Ijoa s n w t ^cc thrr 

grouping, will be receiving at least some of the same (i) . the client SUV 7 also goes directly to the URL specified by 
hotspots and (ii) associated hyperlinks. Note that these the hyperlink, but this URL is commonly (a portal of) the 
Ghent SUVs hese same < i) hotspots and (ii) VOW Server i. 

associated hyperlinks at the same time. Moreover, and in Referring to FIG. 3c, the third step is dynamic Hyperlink 

accordance with the invention presently being explained, an 20 resolution. The VOW server 1 resolves the link and sends a 
initial receipt of the same (i) hotspots and (ii) associated URL back to the Client SUV 7. It also logs the request, 
hyperlinks at each of several Client SUVs does not neces- Referring to FIG. 3d, the fourth step is when the Client 
sarily mean that, should each "click through" on a hotspot/ SUV 7 fetches the video/web page/slide show using the 
hyperlink, that each will ultimately access the same network resolved hyperlink. The Client SUV typically fetches this 
resource. 25 video or other URL resource from the video server 9, or 

The connection of the ISP 5, and also the SUVs 7, to the ' from yet another site on the network 4. 
high speed network 4, or, typically, the internet, can be ' During all this process, and the viewing of hypervideo, 
through any of (i) a cable modem network, (ii) a satellite the hypervideo is preferably presented at the VOW VCR of 
network, and/or a (iii) ADSL (a telephone network). each SUV 7 substantially as is shown (for a first, primary, 

The SUVs 7 are necessarily connected to the network, 30 screen out of several potential such screens) in FIG. 4. The 
typically the internet and more typically the world wide web, ' manner of realizing this screen, and the associated 
1 link -normally, a cable modem—in functionality, is taught within the companion patent appli- 
order to support video/hypervideo. The SUVs 7 each inde- cation. For the moment, however, it needs only be under- 
pendently view and interact with the hypervideo (and other stood that the "video-on-web" VCR, or "VOW VCR", acts 
video and downloaded content) through a software-based 35 as a web-based playback client through which a SUV 7 can 
functionality called, for purposes of continuity with the select channels, just as the SUV might with a normal TV, so 
previous acronym of "VCR" (i.e., a Video Cassette as to play back hypervideos or just plain videos. In so doing 
Recorder), a "Video On Web Video Cassette Recorder" the VOW VCR presents the usual VCR-like controls 71 for 
(although no cassette likely exists), or simply a "VOW video play back including fast-forward, pause, rewind and 
VCR". 'Hie function of such a VOW VCR is taught in a 40 fast-reverse. The Client SUV 7 uses a simple cursor (not 
companion patent application. Basically it behaves like a visible in FIG. 4) to control the playing of stored videos, 
VCR to play and record video with the added function that whereas for live videos clicking on an simple play-and- 
it can respond to click-! h roughs on hotspots to interpret and pause control suffices. 

respond to associated hyperlinks — normally by going out ' When playing hypervideos the VOW VCR displays the 
onto the network 4 to a designated URL, and most normally 45 main video in one screen, as at screen 72. Hotspots 
to (some portal of) the VOW server 1. present — and hotspots are neither always nor invariably 
FIG. 2 shows the Sow of events from a software- present— are displayed as is exaggerated, for ease of recog- 
component-point-of-view of the architecture. The receipt of nitson in the drawing, at hotspot 73. A text annotation (not 
Client SUV activity triggers the flow. This activity is typi- shown in FIG. 4) preferably appears about the object when 
cally a Client SUV click through but also can be a timed so the SUV 7 does a mouse-over on the object. These annota- 
event on the Client SUV side, or an event associated with the tions can beneficially serve to impart additional, 
playback of video by the Client SUV. The server receives the supplemental, information about the scene and/or the objects 
necessary information such as the Client SUV identification, in it and/or the hotspot, such as, for example, the identity of 
current stream, current position in the playback and event a particular person in a depicted group of persons. More 
type and invokes the appropriate sub-program. The VOW ss commonly, however, the annotation is, or includes, or indi- 
Se ^ et ch< ks i j [ - ~ < t adwl and, rectly links, a Universal Resource Locator, or URL, If the 

if required, loads the sub-program and passes the informs- SUV 1 clicks on the hotspot 73 that is associated with a URL 
tion received from the client. The sub-program in turn passes - directed to the VOW sever — and most are — then the video- 
the information to the appropriate COM object which per- oo-web VCR (the "VOW VCR") writ jump to the VOW 
forms the core processii le database and 60 Server 1 (shown in FIG. 1). 

also, if necessary, updating it. Third, the SUV 7 can click on a record button, and can 

A block diagram of the production of hypervideo — then record the video starting at the current frame locally on 
containing both (i) hotspots and (ii) associated hyperlinks — his hard disk or other media provided that security privileges 
at an authoring station in the content provider (shown in allow him or her to do so. 

FIG. 1) is shown in FIG. 3a. This first step involves content 65 In so performing the VOW VCR display thumbnail 
preparation. A network content provider 2 (shown in FIG. 1) images 74 of scenes which have been defined and delineated 
operates software at an Authoring Station, such as the at the video server 9. See the companion patent application. 
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In the case oi cann • ieo, thest scene changes may well 
have been manually detected, and the scene change bound- 
ary markers king since inserted by an editor sitting at a 
console so as !o annotate the video not in real time. In the 
case of "live" video as is typical of, inter alia, news 
: v- ;.!SS.s, I he scene change boundaries are automatically 
detected at the video server 9, and the associated hyperlinks 
(if any, and which may be sparse in number) inserted much 
in the contemporaneous manner of a court reporter, or of a 
translator. The inserted hyperlinks may be less numerous, 
less well focused, less wide-ranging, and/or less versatile in 
a live video feed. For example, consider a newscast, and 
particularly the newscast sports segment. A (network) broad- 
cast "station" employee at a computer station has readily to 
i i t dst s c base 11, fc ball, 3 ask tba 1 an 

hockey — if only to the league web sites where the team 
scores are posted. As the sports comnieatary and/or sports 
scores unfold in the live videocast, minor link insertions by 
this employee serve to "hyperlink annotate" this portion of 
the news. 

At any time about twenty-one most recent such thumb- 
nail images 74, representing twenty most recent scenes will 
displayed. When a new scene is detected it enters the lowest 
corner while the oldest scene is discarded in a iirst-in, 
first-out (FIFO) fashion. The video corresponding to these 
twenty scenes is also buffered in FIFO fashion on local 
storage, Tne SUV can click on any of the scenes to start 
recording from that scene. The implication of this is that the 
SUV can record video which has gone by; such as a sports 
action shot or a talk-show dialogue. 

Returning to FIG. 1, the premises of the ISP 5 typically 
contain both (i) one or more video server 9 and (ii) the VOW 
Server 1. Either server can, of course, be physically located 
elsewhere on the network 4. 

A schematic block diagram of the architecture of a portion 
c i vim accordance with 

the present invention (as was previously diagrammatically 
shown in FIG. 1) is shown in FIG. 5. This portion includes 
(i) the network content provider 2, (ii) the network "video on 
web" control server, or VOW Server 1 which is commonly 
physi illy located at the ISP 5, and (iii) the "video on web 
VCRs", or "VOW VCRs" of the client SUVs 7, and (iv) the 
network 4. The video stream 91 originates at the video server 
9; the control stream 11 at the VOW Server 1. Both streams 
9.1, 11 are synchronized, and are received at the VOW VCR 
of a client SUV 7. More particularly the video stream 91 is 
received at the player module 71 of the VOW VCR of a 
client SUV 7 while the control stream 11 is received at the 
control module 71 of the VOW VCR of a client SUV 7. Both 
player module 71 and control module 11 will be understood 
to be software functions. 

A diagrammatic view illustrating that a Client SUV whose 
VOW VCR is playing hypervideo may click on a hoispot to 
branch to a network page display, or "web page", is illus- 
trated in FIG. 6. 

likewise, a diagrammatic view illustrating that a Client 
SUV whose VOW VCR is playing hypervideo may click on 
a hotspot to alter:].'.. . ■ to another video, or 

hypervideo, is illustrated in FIG. 7. 

Finally, a diagrammatic view illustrating that a Client 
SUV whose VOW VCR is playing hypervideo may click on 
a hotspot to alternatively branch to — by way of example 
among many different network resources two of which have 
already been diagra n rat i in FIGS. 6 and 

7 — a slide show is illustrated in FIG. 8. 

A lop-level software flow chart of the VOW Server of the 
present invention, by which software a Client SUV hyper- 
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link "click-through" request is dynamically resolved, is 
shown in FIG. 9. 

Second-level software flow charts of the sequence of 
processing the Client SUV hyperlink "click-through" 
c oi ti3e t-eseni invent. on ire 
shown, respectively for the processes "A" and "B" identified 
in the top-level flow chart of FIG. 9, respectively in FIGS. 
10 and 11. 

FIG. 9 shows the overall flow in the main branch of 
10 processing. The information from the client is passed on to 
the user progression tracker mod;j!; w, , i s . ■ ; ponsible for 
keeping track of user navigation in hypervideo click- 
throughs and playback status of the user. The progression 
tracker "follows" the user when he navigates through hyper- 
is video and lakes decisions about which links have to be 
supplied next to the user by calling various processing 
modules. It is mostly an entity which depends on time and 
determines if the user is currently watching a comroercia 1, i f 
so, for how long, whether the user has paused the video and 
20 if so for what duration, and so on. There are two main special 
actions that the progression tracker can take apart from the 
main function pertaining to advertisement servicing. They 
are: a decision to award a prize or coupon to the user or a 
security decision (or branch, both of which are described in 
25 subsequent paragraphs). The main branch then continues to 
retrieve the next set of commercials and their associated 
links (including a prize winning coupon link if told to do so 
by the right branch). The main branch checks if any scene 
annotations need to be conveyed to the user, then checks for 
30 text information to be rendered and then dispatches all this 
control information (including the list of commercials) to the 

FIG. 10, or the branch "A" processing occurring in the 
main loop of FIG. 9, shows how the holspt t linking i s Ui ed 

35 to control security and access to videos. In this case, the 
access is of a 'blocking' type — in the sense the client does 
not proceed until it has an answer from the VOW server or 
the user cancels the access. This feature is mainly used for 
controlled access to videos and for commercial purposes — 

40 including e-commerce transactions and implementing pay- 
per-view schemes. In controlled access scenarios it is mainly 
used to restrict child access to restricted adult material. The 
branch "A" is entered when a security or e-comrneree type 
of dick is received. The server proceeds to retrieve the 

45 security information initiates a dialogue with the client. If 
validation returns an affirmative answer, the server proceeds 
to give the links to restricted videos along with access keys. 
A similar situation occurs if the access is to a pay per view 
video. If the click is on a e-commerce transaction, the 

so necessary steps to complete that transaction are completed. 
FIG. 11, oi the branch "B" processing occurring in the 
main loop of FIG. 9, outlines the decision to award a user a 
coupon or prize when he/she clicks on a hotspot in the 
commercial. Essentially, this module keeps a count of the 

55 nutnber of times the user accesses the particular commercial. 
If the count is greater than a certain value it qualifies (he user 
for a selection (which might be a random or may employ any 
other scheme awards that user a prize or coupon. The count 
is also recorded in the database to give the advertiser 

60 statistics on the number of user accesses to his commercial. 
This mechanism will also be used to award or inform or 
take some special action when the user clicks on a non- 
commercial hypervideo. If the flag has already been set i.e 
in the left branch of the figure, the win is recorded and an 

65 e-mail or other suitable is employed to make the user aware 
that he has won a coupon or prize. In the right branch of the 
figure which illustrates the process when the access flag has 
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not yet been set. What happens in this branch has been 
summarized in the preceding paragraph. 

Thus FIG. 1 has shown a block schematic of the video 
server, the VOW server, the client and the network on which 
these components are connected. FIG. 5 has illustrated the 5 
flow of data on the same network 'pipe' from video server 
to the playback module of the client and the control stream 
flowing Jo she contra] module of the client. Both these 
streams are drawn or pulled by <hc r s jectiv 
client. 1Q 

{ he preparation of the authored 

v!PB stream to ictuai playback of dynamic hyperlinks 
have been described Die r step is s< c j as in video 
are tracked and marked as hotspots and then associated with 
n be either static or dynamic. However, 
the focus of this disclosure is the concept of dynamic J s 
hyperlinks and their use for interactive commercials. When 
''■■ies dynamic links 
in she stream, co-ordinates with its control module which 
would have fetched the required links (at playback time) and 
plays back the appropriate streams from the video server. ?.o 

This dynamic form of linking, meaning that the link is 
decided at playback time, is the theme of the present 
invention. This concept can be used in several different 
*»ys,${ .'• Il> detailed in various parts of this disclosure. 
The principle focus is the usage of the concept of dynamic 25 
hyperlink resolution for (i) timely (i.e., non-stale) delivery 
of (ii) Client SUV-specific interactive commercials, using 
the VOW sever as the vehicle for delivery. 

The scheme of the present invention opens up new 
opportunities for businesses to attract new markets in a 
big! 3 fas i - d -*.ount 

offerings, coupons and prize schemes. In addition, it helps 
the advertiser to develop statistics on everything from (i) 
click-throughs of all Client SUVs to particular hyperlinks, to 
(ii) the click-throughs of some particular Client SUV to 
particular hyperlinks, to (iii) the ensuing conduct, potentially 
including on-line purchases and submissions and expres- 
sions of interest, of a particular Client SUV is following a 
particular hyperlink. This is in marked contrast to conven- 
tional broadcast television where there is no interactivity 
with the viewer and/or the viewer's video playback, espe- 
cially including commercials, 
6, Recapitulation of the Invention 

This present specification has described hyperlink reso- 
lution at and by a special network server in order to enable 
diverse sophisticated hyperlinking upon a digital network 
streaming digital hypervideo from a network hypervideo 
server to network clients. The special server operates in 
conjunction with (i) a network video server and (ii) a special 
client called a VOW VCR (which VOW VCR is described 
in a separate patent application). 

The objectives of the present invention, and of the special 
server, are as follows. Ii acts as a tool to insert customized 
hypervideo, normally commercials, in the hypervideo 
streams that are displayed at individual network Client 
subscriber/users/viewers (Client SUVs). It serves to resolve 
hyperlinks at run time, i.e., to process user clicks on objects 
in hypervideo (including, but not limited to, advertisements) 
so as to determine the link to which the Client SUV will go 
to, or a network resource which the Client SUV will access. 
This process is referred to as 'dynamic hyperlink resolu- 
tion*. 

This concept of dynamic hyperlink resolution may be 
used to implement, for example, a lottery, a contest, or a 
coupon distribution. H permits of interactive commercials 
h u to unseen in streaming digital video or in television 
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The dynamic hyperlink resolution may be used to supply 
security information to, and to enforce security restrictions 
on, the' VOW VCR of the Client SUV; such as whether the 
Client SUV has the authority to record a particular clip or 
not, or whether he/she can jump to a particular clip on a 

Finally, the dynamic hyperlink resolution serves to record 
Client SUV click-throughs, and to use this information o 
develop statistics on Client SUVs both collectively and, 
importantly, individually. 

The o vera J rch re of I tern was seen in FIG. 1. 
The control stream was generated by the special server, 
called a VOW Server, that qualified and added value to the 
video stream generated by the video server. Both streams 
were drawn by each Client SUV, the control stream being 
synchronized with the video stream. The video stream could 
either be generated live — such as by an encoder plus a 
camera system — or could be delivered from secondary 
storage— -such as a hard disk. In general, the video stream 
contained static information such as the tracked information 
of objects in a hypervideo stream while the generated 
control stream contained dynamic information such as the 
hyperlinks. 

The block diagram of the VOW Server was seen in FEG. 
6. As stated earlier, the hyperlinks are dynamically resolved 
in this software function based on which Client SUV is 
clicking on what hyperlink, and the time of the clicking. 
The process of dynamic hyperhnking was seen to be as 
3D follows: The Client SUV clicks cm a "hot spot" object in the 
hypervideo, say an "object 1". This action is conveyed back 
to' the VOW Server by the client software, the VOW VCR. 

The VOW Server (a software process) sends the Client 
SUV time and action information to its resolution compo- 
35 nent. The resolution component uses the data and retrieves 
an appropriate link to an advertisement, a pointer (link) to a 
network resource, or a link to a response, lite response could 
be, for example, an announcement of a contest of a lottery 
result: "you've just won a trip to Hawaii", or "you've won 
-to a free dinner for two at the Greek restaurant". A link to an 
appropriate video, hypervideo or network resource is thus 
conveyed back to the Client SUV — which the Client, SUV 
sees and uses to decide bis or her future course of action. 
The control generation module of the VOW Server is 
45 responsible for taking in the various SUV actions and 
generating the control stream based on various data it 
retrieves from the various sub modules, all as was shown in 
the. flow charts. 
Notably, there must have been, and there is, a necessary 
50 preparation of hyperlinks before they are available — even in 
common — to be exercised at the Client SUVs. In particular, 
a scene change module functions as taught within a related 
patent application to recognized (in real time!) the scene 
change boundaries of streaming digit:!! video. Thi 
55 stored on the server are indexed in terms of scenes, with a 
text annotation added to each of these scenes. The VOW 
Server stores a list for each of these MPEG streams. Each 
item in the list consists of two fields: 1) one field is the frame 
number of the scene change point being authored and 2) the 
60 other has the annotation (the text string) corresponding to it. 
As the VOW VCR software process at the Client SUV 
proceeds through the video, it will receive, as part of the 
stream from the video server, the, scene change frames and 
heir corresponding exf rtnotstions Oi th elk i th 
6S client player (the VOW VCR) displays a thumb nail image 
of a characteristic (first) scene frame, and further displays 
the text annotation when the user does a mouse-over on the 
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thumb nail image, A timer module was responsible for 
timing the insertion of the commercials. 

It is thus possible to understand how the hyperlinks come 
to exist in the first place, Returning now to the functions 
more directly performed by the VOW Server of the present 5 
invention, this VOW Server runs )as a software process) a 
user data module and advertisement component stored the 
Client SUV profile and information such as age, sex and 
inter - This profile and information was used by the 
advertisement component to select an apptoj iate oustncr 
cial for the Client SUV, The user data module and adver- 
tisement component also kepi track of the cornrneteiafs 
clicked by the Client SUV so that overall statistics can be 
extracted ou s 1 i sent component as regards the 
Client SUV behavior for the commercials. The advertise- j s 
meat component was thus responsible for retrieval of the 
appropriate ad or other response to a particular Client SUV, 
making its decisions based on the previous data for that 
Client SUV and also global information. Third party com- 
ponents for this particular advertisement component, if 2Q 
suitable, may also be substituted for this function. For 
example, Client SUV preferences might be recorded and 
t e ' stii or on fuzzy logic, filters. 

in addition, the control stream generation module was . 
able to generate security information for the video stream 2J 
which controlled whether the video could be recorded or not 
at the client. 

In accordance with the preceding explanation, variations 
and adaptations of the system and methods of the present 
invention for real-time targeted insertion of video and byper- 30 
video clips and hyperlinks in compressed streaming video 
(including dynamically at multiple points between content 
providers and subscribers in digital networks) will suggest 
themselves to a practitioner of the digital communications 
arts and sciences. 35 

In accordance with these and other possible variations and 
adaptations of the present invention, the scope of the inven- 
tion should be determined in accordance with the following 
claims, only, and not solely in accordance with that embodi- 
ment, within which the invention has been taught. ^ 

What is claimed is; 

1. A method of resolving hyperlinks present in hypervideo • 
distributed upon a digital communications network, She 
method comprising: 

distributing from a first, hypervideo, network server upon 45 
a digital network to each of a multiplicity of network 
client subscribers/users/viewers digital hypervideo 
containing hyperlinks that Sink when exercised to a 
second, hyperlink-resolving, network server; 

selectively exercising at the network client subscribers/ 50 
users/viewers the hyperlinks so as to cause coinmuni- ■ 
cation linkage upon the network to the second, 
hyperSink-tesolving, network server; 

resolving at the second, hyperlink-resolving, network 
server all received, selectively -ox c ppediaksii a- 
consideration o: the indii l«a necw jr 
hyperlink-exercising client subscribers/users/viewers 
and, consequent to this resolving, communicating back 
across the digital network to the hyperlink-exercising 
and communicating client subscribe ts/users/vieweis 60 
linkage information that is n ica for all, but that 

is instead different for at least two of these hyperlink- 
exercising and communicating client subscribers/users/ 
viewers; and 

communicating 65 
client subscribers/users/viewers linkage information 
from the second, hvp*. r! r> 
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and acting upon this linkage information to access 
resources upon the network; 
wherein the resources accessed by at least two of the 
hyperlink-exercising and communicating client 
t '-cfi)dcs.s to 

the fact that the hyperlinks within the hypervideo 
originally distributed to both were the same. 

2. The method of resolving hvperlinks according to claim 

1 

wherein the interpreting at the second server is so as to 
communicate back a rc < information in 

the nature of a network universal resource iocator to the 
hyperbt-f xer s > cribers/users/viewers 

3. The metb >c perlinks according to claim 

1 

wherein, consequent to the receipt of the information at 
the hyperlink-exercising and communicating client 
subscribers/users/viewers, the. resource is retrieved 
upon the network. 

4. The method of resolving hyperlinks according to claim 

1 

wherein, consequent to the receipt of the information tit 
the hyperlink-exercising and communicating client 
subscribers/users/viewers, the resource is retrieved 
locally, within the client subscribers/users/viewers. 

5. A method of resolving hyperlinks present in hypervideo 
distributed upon a digital communications network, the 
method comprising: 

communicating streaming digital hypervideo containing 
hyperlinks upon a digital network from a first, 
hypervideo, server to each of a multiplicity of network 
client subscribers/users/viewers where at least two cli- 
ent subscribers/users/viewers receive the same hyper- 
link; 

selectively exercising at at least two of the network client 
subscribers/users/viewers the same hyperlink so as to 
cause these exercising client subscribers/users/viewers 
to communicate upon the digital network to, in accor- 
dance that the exercised hyperlinks are the same, a 
same port of another, second, network server; 

receiving at the port of the second network server noti- 
fication of the exercised hyperlink from each of the at 
least two client subscribers/users/viewers so exercising 
the same hyperlink; 

interpreting at the second server all received exercised 
hyperlinks in consideration of the individual network 
identities, known to the second server, of the hyperlink- 
exercising client subscribers/users/viewers and, conse- 
quent to this interpreting, communicating back across 
the digital network to the hyperlink-exercising and 
communicating client subscribers/users/viewers infor- 
mation thai is not identical for all, but thai is instead 
different for at least two, of the hyperlink-exercising 
and communicating client subscribers/users/viewers as 
did exercise the same hyperlink; and 

receiving at the hyperlink-exercising and communicating 
client subscribers/users/viewers the information that is 
different for at least two of these hyperlink -exercising 
di ^ cc -• t tut J. } )S ser iewers i 

did originally exercise the same hyperlink, and, con- 
sequent to the receipt of this information, retrieving a 
resource in accordance therewith, the different infor- 
mation leading to different resources so that at least two 
of the hyperlink-exercising and communicating client 
subscribers/users/viewers thai originally exercised the 
same hyperlink do not retrieve the same resource but, 
instead retrieve different resources; 
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wherein at least some hyperlink-exercising client 
subscribers/users/viewers, nonetheless to originally 
exercising the same hyperlink, ultimately retrieve dif- 
ferent resources. 

6. The method of resolving hyperlinks according to claim 5 

5 

wherein the interpreting at the second server the received 
exercised hyperlinks is further in consideration of addi- 
tional data individually associated with each of the 
hyperlink-exercising clien! subscribers/users/viewers, 10 
the identities of which hyperlink-exercising client 
subscribers/users/viewers are known. 

7. The method of resolving h\r rd 

6 

wherein the interpreting is further in consideration of - 
additional data of the nature of demographic data. 

8. The method of resolving hyperlinks according to claim 

6 

wherein she interpreting is further in consideration of 
additional data of the nature of socioeconomic data. 

9. The method of resolving hyperlinks according to claim 20 

6 

wherein the interpreting is further in consideration of 
additional data of the nature of credit data. 

10. The method of resolving hyperlinks according to 
claim 6 25 

wherein the interpreting is further in consideration of 
additional data of the nature of hypervideo-viewing 
preference, data previously expressed by the individual 
client suhscrihers/users/viewers. 

11. The method of resolving hyperlinks according to 30 
claim 6 

wherein the interpreting is further in consideration of 
additional data of the nature of past hyperlinks exer- 
cised by the individual client subscribers/users/ 3J 
viewers. 

12. The method of resolving hyperlinks according to 
claim 11 further comprising after the interpreting: 

updating at the second server a database of information 
concerning past hyperlinks exercised by the individual ^ 
client subscribers/users/viewers in consideration of the 
hyperlink just exercised, and just interpreted. 

13. A digital communications network distributing hyper- 
video with embedded hyperlinks comprising: 

a digital communications network; 45 

a first, hypervideo, network server distributing upon the 
network to each of a multiplicity of network client 
subscribers/users/viewers digital hypervideo contain- 
ing hyperlinks that link when exercised to a second, 
hyperlink-resolving, network server; so 

a multiplicity of network client subscribers/users/viewers 
upon the network receiving thereupon the hypervideo 
from the first, hypervideo, network server, and selec- 
tively exercising the hyperlinks so as to cause commu- 
nication hyperlinking upon the network to the second, 55 
hyperlink- resolving, network server; 

a second, hyperlink-resolving, network server resolving 
all received, selectively-exercised, hyperlinks in con- 
sideration of the individual network identities of the 
hyperlink-exercising client subscribers/users/viewers 60 
and, consequent to this resolving, communicating back 
across the digital network to She hyperlink-exercising 
and communicating client subscribers/users/viewers 
linkage information that is not ideotica I for all, but that 
is instead different for at least two of these hyperlink- 65 
exercising and « mi 1 > 1 -^.ibers/users/ 
viewers; and 
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wherein the hyperlink-exercising and communicating cli- 
ent subscribers/users/viewers, upon receiving the link- 
age information from the second, hyperlink-resolving, 
network server, do act upon this linkage information to 
access resources upon the network; 

wherein at least two of the hyperlink-exercising and 
communicating thci a ."-/viewers do 

access different resources upon the network nonethe- 
less to the fact that the hyperlinks within the hyper- 
video originally distributed to both were the same, 

14. A cotnputerized process performed at a digital com- 
munications network server in response to receipt of notice 

.^'11 subsc iber/user/viewei c .'• of many 
subscribers/users/viewers upon the network to the effect that 
the particular client subscriber/user/viewer has volitionally 
selected a hyperlink, the process comprising: 
comparing (i) a unique identity of the particular client 
subscriber/user/viewer who has volitionally selected 
the hyperlink with (ii) a pre-existing database of infor- 
mation regarding, inter alia, the particular client 
subscriber/user/viewer; and 
choosing and providing a response to the particular client 
subscriber/user/viewer in accordance with the informa- 
tion stored within the pre-existing database of infor- 
mation; 

wherein the process is called "dynamic hyperlink resolu- 
tion": because the response to each subscriber/user/ 
viewer who has selected the same hyperlink is not the 
same for all subscribers/users/viewers, but is dependent 
upon the individual one subscriber/user/viewer. 

15. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of universal resource locator, 

16. Th& process according to claim IS 

wherein the chosen and provided response in the form of 
universal resource locator is directed to an advertise- 
ment targeted to the particular client subscriber/user/ 
viewer. 

17. The process according to claim IS 

wherein the chosen and provided response in the form of 
universal resource locator is directed to a coupon 
targeted to the particular client subscriber/user/viewer. 

18. The process according to claim 15 

wherein the choosing and providi g is of an xsnseinth 
form of a control signal and accompanying information 
to the client subscriber/user/viewer. 

19. The process according to claim 18 

wherein the chosen and provided response in the form of 
a control signal and accompanying information caases 
branching by the particular client subscriber/user/ 
viewer. 

20. The process according to claim IS 

wherein the chosen and provided response in the form of 
a control signal and accompanying information causes 
a display by the particular client subscriber/user/ 
viewer. 

21. The process according to claim 14 further comprising: 
running a contest of skill among the colk ctive nc ' 

all subscribe 

ally select a particular hyperlink; 
wherein the choosing and providing is of a response in the 
form of a win/lose notification of the contest, 

22. The process according to claim 14 further comprising: 
running a lottery of chance among the « t 

of ail subscribers/users/viewers who do timely volition- 
aliy select a particular hyperlink; 
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wherein the choosing and providing is of a response in the • 
form of a win/lose notification of the lottery. 

23. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of a dunning notice targeted to the particular one 5 
subscriber/user/viewer who has not paid his or her bill 
from the network service provider. 

24. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of a pay-per-view video presentation. J 

25. The process according to claim 14 further comprising: 
keeping track of the notice from the particular subscriber/ 

user/viewer, and other notices from the same . 
subscriber/user/viewer, as accumulated information 3J 
revealing the preferences and the activities of the 
particular subscriber/user/viewer. 

26. The process according to claim 25 further comprising: 
pcoviding hyperlinks in the first instance to the particular 

subscriber/user/viewer in consideration of previously 20 
accumulated information regarding the preferences and 
the activities of the particular subscriber/user/viewer. 

27. In a digital communications network where hyper- . 
video containing hyperlinks is communicated from a digital 
hypervideo server to a client subscriber/user/viewer, a 2 s 
method of resolving a exercise of a particular hyperlink by 

a particular client subscriber/user/viewer out of many such 
subscribers/users/viewers upon the network, the method 
comprising: 

communicating the exercise of the particular hyperlink by 30 
the particular client subscriber/user/viewer over the 
network to a control server where is stored (i) all 
hyperlinks and (ii) information in respect of ail 
subseribers/users/viewers; 

he digital communications network to 35 
the particular client subscriber/user/viewer a universal 
resource locator in accordance with (i) the exercised 
hyperlink, and (ii) the stored information; 

using at the client subscriber/user/viewer the universal • 
resource locator received across the digital communi- 40 
cations network to access a network resource; 

wherein the process is called "dynamic hyperlink resolu- 
tion": because the universal resource locator provided 
each subscriber/user/viewer who has selected the same 4J 
hyperlink is not the same, but is instead dependent upon 
the stored information. 

28. The method according to claim 27 

wherein the provided universal resource locator is to an 
advertisement in respect of the individual client 
subscriber/user/viewer exercising the hyperlink. 
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29. A computerized security process performed at a net- 
work service provider providing upon a communications 
network hypervideo to each of a multiplicity of subscribers/ 
users/viewers upon the network, the process comprising: 

receiving upon a digital communications network com- 
municating hypervideo notice from a particular client 
subscriber/user/viewer out of many subscribers/users/ 
viewers of hypervideo upon the network to the effect 
that the particular client subscriber/user/viewer has 
volitionally selected a hyperlink; 

comparing (i) a unique identity of the particular 
suhscriher/user/viewer to whom the hypervideo has 
beet! supplied with (ii) a pre-existing database of infor- 
mation regarding, inter alia, the preferences of each 
individual subscriber/user/viewer; and 

choosing and providing a particular hyperlink to the 
particular subscriber/user/viewer in accordance with 
the information that was stored in the database regard- 
ing that particular subscriber/usei/Viewer; 

wherein no subscriber/user/viewer will receive hyperlinks 
offensive to or inconsistent with pre-existing informa- 
tion regarding that subscriber/user/viewer, and, instead, 
each subscriber/user/viewer will receive only hyper- 
links that are consonant with and in respect of the 
pre-existing information regarding that subscriber/user/ 
viewer. 

30. A computerized security process according to claim 

29 

wherein the comparing is to a pre-existing database of 
information regarding, inter alia, the status of accounts 
of each individual subscriber/user/viewer; 

wherein hyperlinks to added cost services are omitted 
from hypervideo network communicated to 
subscribers/users/viewers whose accounts are in 
arrears. 

31. A computerized security process according to claim 

29 

wherein the comparing is to a pre-existing database of 
information regarding, inter alia, the acceptability of 
information of certain types to each individual 
subscriber/user/viewer; 

wherein hyperlinks io information of certain types are 
omitted from hypervideo network communicated to 
subseribers/users/viewers who do not find such types of 
information acceptable. 
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ABSTRACT 



Different commercial messages are broadcast to differ- 
ent demograpbically targeted audiences in a cable tele- 
vision system or the like. A first television channel con- 
tains television programs and periodic commercial mes- 
sages. A second television channel contains alternate 
commercial messages. Demographic characteristics of a 
viewer are identified, and commercial messages are 
selectively provided from the first or second channel, 
depending wpon the viewer's demographic characteris- 
tics. Demographic data can be input by a viewer via a 
remote control, downloaded to a subscriber's converter 
from a remote headend, or programmed into the con- 
verter at installation. Prioritization of the demographic 
characteristics of a plurality of television viewers 
watching a program together enables commercials to be 
targeted to the viewer having highest priority. Statisti- 
cal data can be maintained concerning the number and 
identity of subscribers viewing specific commercials. 
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information" carried on a particular television channel the converter at any given instant. This implementation 
and inputs the information to microprocessor 30. FM provides a dynamic system where the viewer demo- 
data receiver 26 receives other information from the • graphics can change at any time. In addition, multiple 
headend (i.e., descrambler authorization data) for input viewer data and/or demographic types can be entered 
to microprocessor 30. The use of AM and FM data 5 and stored in the converter. A "delete" button can be 
receivers in cable television converters for retrieving provided to tell the system that a particular demo- . 
tag information and addressable data is well known. graphic type has left the viewing area. Prioritization of 
Operational software for converter 10 is contained in multiple viewers for use in selecting appropriate corn- 
ROM 32. Existing cable television converters, such as mercials is handled as described below in connection 
the DP5/DFV5/DPBB converters and the DP7 family 10 w j tn p-jQ 4. 

of converters manufactured by the Jerrold Division of Alternate methods of identifying viewer demo- 
General Instrument Corporation can be upgraded to graphic types include a passive approach, relying upon 
implement the present invention by interchanging the image recogn jtion technology to determine what 
ROM chip contained in the converter with a new ROM v j ewef or viewers are watching television at any given 
device containing additional software. 15 time Demographic types can also be identified using 

A serial number PROM 34 in converter IS contains a household survey or diary information, known address- 
unique code identifying the converter to the headend, /neighborhood locations or known ethnic locations, 
enabling the converter to be addressed on an individual Information determined by such techniques is trans- 
basis. RAM 36 is the operating memory for micro- ferred jnto RAM 36 of converter 10 on an individual 
processor 30, and m accordance with the present .nven- 20 ^ b a technician M!ing &e converter, or via a 
nor. stores data indicative of demographic characters communic&tion tmm the cabk systeH! hesdmd which 
toes of a viewer or viewers onng the converter at any addmses 10 , via fm data receiver 26, to 
given time. RAM 36 may also store data indicative of down]oad the demographic data . This approach allows 
the television channels or other cable services selected ^ headend t£> u ^ a f e md modify changes ^ household 
by particular. demographic types. This data can be ap- 25 fitkmnetra . - w ...kLjw 
pended with date and time information by microproces- <T^£j£££ wi^ resent invention 
sor 30, to enable subsequent cross-referencing of chan- i A n ^7°, , . BCCOroancc w, "» p , m jl 
nels selected bv viewers to the programs shown on the tc ' v,s,on f°8 ram c *»™?* *° converter 10 
channel at the time of selection to « ether ™ th se f arate channels containing commercial 

LED display 38 outputs the television channel num- 30 messa 8« < ie > advertisements). Information alerting the 

ber to which the converter is tuned by a viewer. IR converter as to when a commercial message break is 

receiver 40 receives data transmitted by a handheld about to occur durmg a tekvtsion program and ^denti- 

remote control for input to microprocessor 30, Keypad ^I^SS^SSTSSSS^ Si J2E 

42 enables users to input channel selection and other demographic audiences, is transmitted by the headend 

information to the converter directly without the use of 35 m thc form of te 8 mSbrmatson on i the particular televi- 

a handheld remote control SSOK program channel to which the converter is tuned. 

A remote control 120 for use with converter 10 is ™* *8 ^formation is detected by AM date receiver 22 
illustrated in FIG, 2. Data are transmitted from the ««> SI3 P ut ! f microprocessor 30, which forces timer 18 
front end 122 of remote control 120 using an infrared or to t5Mse m appropmtecommercial message channel 
equivalent remote data path. A plurality of conven- 40 at the appropriate time. Use AM teg data detected by 
ttonal function buttons 132 and channel selection but- receiver 22 is carried on the audio portion of the televi- 
sions 134 are provided. In accordance with the present SSOB program signal m a conventions] maimer, AJter- 
mveution, a plurality of switches 124, 126, 128, 13© is natd y. the teg date can be included w the vertical 
provided to enable a user to input demographic data to banking interval using known techniques to alert cos- 
converter 10. For esample, switches 134 and 126 can be 45 vertef *<> <v» microprocessor 30) that a commercial 
provided to mdie&te that the viewer is an adult male or break is about to occur. 

female, respectively. Switches 128 and 130 can be pro- Once converter 1© has been alerted that a commercial 
vlded to indicate that the viewer is a male or female message break is imminent, it identife the demographic 
child, respectively. Other demographic information can characteristics of the current viewer from date stored in 
alternately be provided via switches 124-130, or by the SO KAM 36. The converter software stored m ROM 32 
provision of additional demographic switches on re- then initiates an automatic channel change during a 
mote control 120. Equivalent switches can also be pro- vertical blanking interval to the specific cosinmereki 
vided on the converter itself, as part of keypad #2. In an message channel to which the demographic eharaeteris- 
alternate embodiment, a user code is entered on the tics correspond. This channel is maintained for either a 
numeric keys of the remote control or converter to 55 pre-established fixed time period (e.g., 15, 30, 45 see- 
identify the demographic type of the viewer before any onds, etc.) by a timer operatively associated with micro- 
commands axe executed. Use of a user code would processor 30, or until a "return to original "channel" 
expand the, number of demographic types allowable, but instruction is detected by the converter through teg 
may require additional keys to be actuated to initiate a data transmitted by the headend. After the commercial 
converter response. <50 break, the converter returns back to the original televi- 
In operation, a viewer is required to press a demo- sion program channel during a vertical blanking inter- 
graphic key on the remote control 120 (or on keypad val. Switching back and forth between television pro- 
42) before any other key is depressed to select a channel gram and commercial message channels during the 
or other converter function. The demographic data vertical blanking interval minimizes any visible inter- 
(and any other relevant data, such as data indicative of 65 ruption to the television viewer. The software for ac- 
the converter function selected) are then stored in complishing the returning of tuner 1® contains program 
RAM 36 so that the converter knows what demo- . instructions that will be apparent to those skilled in the 
graphic Sype is watching the television associated with art. 
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means, responsive to data stored in said storing 
means, for directing viewer apparatus serving said 
one of said viewers to tune to a designated channel 
during said periodic commercial message break for 
receipt of one of said plurality of different televi- 
sion commercials targeted to the viewer. 

9. A system for automatically selecting, television 
programs and commercials for a viewer, based on data 
pertaining the viewer, comprising; 

means for storing data indicative of predetermined 
characteristics of said viewer; 

means, responsive to said stored data, for causing a 
television signal receiver to select from a plurality 
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of programs a television program targeted to view- 
ers having said characteristics; and 

means, responsive to said stored data during a com- 
mercial message break of said selected television 
5 program, for directing said television signal re- 
ceiver to select, from a plurality of commercials, a 
television commercial targeted to viewers having 
said characteristics. 

10. Apparatus in accordance with claim 5 wherein 
10 said actuating means comprises; 

a timer for actuating the return to said first television 
channel a predetermined time period after a com- 
mercial message break has commenced. 
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